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DataLab 


Analyse the most detailed microdata in the secure DataLab for your statistical research or modelling, find out about charges 


and how to access 
Released 4/11/2021 


[] Log into DataLab (https://new.datalab.abs.gov.au/) 


What is DataLab 


DataLab is the analysis solution for high-end users who want to undertake real time complex analysis of detailed 


microdata. Compare data services (/about/data-services/compare-data-services) to see if detailed microdata in the DataLab 


is the right service for you. 


Note: Government organisations seeking to leverage the DataLab cloud infrastructure to host their own data and manage their 


own end-users should consider the Secure Environment for Analysing Data (SEAD) (https://www.abs.gov.au/about/data- 


services/secure-environment-analysing-data-sead) service. 


Features 


e View and analyse unit record information 
e Recent versions of analytical software, including R, SAS, Stata and Python 


Virtual access to files that remain in the secure ABS environment 


e All analytical output that you want to use outside DataLab are checked by the ABS before release 
Who can access the DataLab 


Detailed survey and integrated microdata are available for approved projects, organisational users must be: 


* government employees 

¢ government contractors and individuals sponsored by government 
* academics 

e researchers from public policy research institutes 


e sponsored by government 


All users need to also meet ABS safe people criteria, including researchers who: 


belong to an Australian organisation (international researchers and organisations will be considered on a case by case 
basis) 


belong to an organisation with a Responsible Officer Undertaking (/statistics/microdata-tablebuilder/responsible-use-abs- 
microdata/undertakings-and-declarations#responsible-officer-undertaking) (ROU) in place with the ABS 


are located in Australia when accessing the microdata 


have completed all relevant undertakings and declarations (/statistics/microdata-tablebuilder/responsible-use-abs- 
microdata/undertakings-and-declarations) 


have the ability to use at least one of the statistical analytical languages available in the DataLab 


have at least three years of either quantitative research experience or university study with a significant component 
working with quantitative data, or have a referral from an experienced researcher working on the same project 


have an approved safe project that is for statistical and/or research purposes and demonstrates public value 


have completed ABS safe researcher training and refresher training as per ABS refresher policy (/statistics/microdata- 
tablebuilder/datalab/safe-researcher-training#refresher-training) 


meet additional criteria that apply to specific microdata. 


DataLab system security 


The ABS is committed to keeping the ABS DataLab safe and secure. We have a strong data protection culture and extensive 


experience in keeping data secure as Australia's national statistical organisation and as an Accredited Data Service Provider 


(https://www.datacommissioner.gov.au/accredited-entity-register) . The ABS DataLab is hosted in Microsoft Azure and meets 


PROTECTED level security standards as prescribed in the Australian Government Information Security Manual (ISM). It is 
subject to Independent Security Registered Assessors Program (IRAP) certification, ongoing security audits and robust IT 


security testing and patching delivering the Safe Settings aspect of the Five Safes Framework (https://www.abs.gov.au/about/ 


data-services/data-confidentiality-guide/five-safes-framework#five-safes-framework) . 


The technology underpinning the ABS DataLab includes: 


e data encryption at rest to mitigate against unauthorised access to microdata 
e Azure Storage Accounts to securely hold individual research products and allow querying from authorised users 


e cloud servers (including backup servers) hosted exclusively onshore, with access only authorised for use in Australia 
unless approved by the ABS 


closed network virtual machines to provide secure, isolated research spaces for the analysis of microdata 


e guarded access through multi-factor authentication and workspace segmentation inhibiting data sharing between projects 


a DataLab Product Storage Account protected with Microsoft Defender providing threat detection against malicious/ 
unusual behaviour. 


The ABS employs the above with a focus on industry standard security posture management to provide a safe and secure 


platform for policy and program delivery work. 


Detailed microdata in the DataLab 


e Designed specifically for use within the DataLab environment 
e Direct identifiers (such as names and addresses) removed 
e Further appropriate confidentiality applied within the context of the other security features of the DataLab 


e Topics include Census, health, education, labour force, Aboriginal and Torres Strait Islander peoples, migrants, crime, 
business, disabilities, ageing and carers 


e Datasets include ABS survey results, administrative data collected by other organisations and integrated datasets 


e Data item lists are linked in detailed microdata topics in the DataLab (/statistics/microdata-tablebuilder/datalab/topics) 


Charges 


Costs for 2023-24 are now available below. If you have any questions, please contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) . 


Approved users can access standard detailed microdata (/statistics/microdata-tablebuilder/datalab/topics) in DataLab for 


approved projects. This includes: 


e ABS survey and census collections 
e data ABS has collected from other organisations (with custodian approval) 


e integrated microdata such as: 
e Person Level Integrated Data Asset (PLIDA) 


¢ Business Longitudinal Analysis Data Environment (BLADE) Core plus BLADE standard module (various ABS surveys), 
Intellectual Property Longitudinal Research Data (IPLORD) and Merchandise Imports and Exports 


e PLIDA/BLADE linked data 


Additional charges apply for customised data integration services (https://www.abs.gov.au/about/data-services/data- 


integration/data-integration-service) . 


DataLab charges 


DataLab access incurs an annual charge. This charge is based on the number of analysts with virtual machine access ina 


project. The charge covers the annual costs of: 


¢ project establishment and ongoing administration and support 


e researcher onboarding (including training and refresher training) 


e changes to analysts and discussants within a project 

e standard virtual machine access for analysts 

e standard software access for analysts (e.g., R, Python, Stata) 
¢ project storage up to one terabyte 


e standard output and input clearance 


The ABS is committed to supporting the DataLab service and subsidising DataLab users. In 2023-24, increasing costs and 
budget constraints require the ABS to move towards a more sustainable partial cost recovery arrangement with all our clients. 
The below updated charges will allow the ABS to maintain its service levels as well as deliver critical system and infrastructure 


enhancements. 


The ABS is adopting a staggered approach to price increases to minimise the impacts on existing projects. Existing projects 
are projects established before 1 July 2023. Existing and new projects will be subject to different pricing models for 2023-24 


and 2024-25. Please see the below for more details. 


Please note: 


Individual quotes will be prepared for projects with over 25 analysts. 

e An increase in the number of analysts to the next tier will incur an additional charge equivalent to the next tier. 
e Significant changes in project scope may result in the establishment of a new project. 

e Project extensions after 1 July 2023 will be charged at the new project rates. 


e Access to non-standard services are subject to additional charges, please see ‘Additional non-standard access and 
services charges’ table below. 


e All charges are calculated quarterly, based on the month of request. For example, a project commencing in October will be 
charged the annual fee and any non-standard DataLab access based on three quarters of the financial year. 


Annual charges for existing projects 
Existing projects are projects established before 1 July 2023. 
Tier 1 and 2 projects (projects with under 10 analysts) 


e Tier 1 and 2 projects will continue to be charged the same annual rates for financial years 2023-24 and 2024-25. 


e Prices will increase from 2025-26 for all Tier 1 and 2 projects. 
Tier 3 projects (projects with 11 to 25 analysts) 


e Tier 3 projects will be charged half the 2022-23 annual charge of $10,000 ($5,000 excluding GST) for 1 July 2023 to 31 
December 2023, with prices increasing from 1 January 2024. 


e From 1 January 2024, Tier 3 projects will be subject to a new charge rate. 


e Tier 3 projects will be charged half the new 2023-24 annual charge of $30,000 ($15,000 excluding GST) for 1 January 
2024 to 30 June 2024. 


e The delayed roll out of the new charging model provides project leads the opportunity to decrease usage or close their 
project before prices increase. 


Tier 4 projects (projects with over 25 analysts) 
e Tier 4 projects will be charged custom pricing from 1 July 2023 under the new pricing model. 


2023-24 annual charges for existing projects 


Annual charge (per project) Excluding GST Including GST 
Tier 1- 1to 5 analysts $2,000 $2,200 
Tier 2 - 6 to 10 analysts $4,000 $4,400 
$5,000 - 1 Jul 2023 to 31 Dec 2023 $5,500 - 1 Jul 2023 to 31 Dec 2023 


Tier 3 - 11 to 25 analysts 
$15,000 - 1 Jan 2024 to 30 Jun 2024 $16,500 - 1 Jan 2024 to 30 Jun 2024 


Tier 4 - Over 25 analysts Custom Custom 


Annual charges for new projects 
New projects are projects established after 1 July 2023. 


2023-24 annual charges for new projects 


Annual charge (per project) Excluding GST Including GST 
Tier 1- 1to 5 analysts $5,000 $5,500 
Tier 2 - 6 to 10 analysts $12,000 $13,200 
Tier 3 - 11 to 25 analysts $30,000 $33,000 
Tier 4 - Over 25 analysts Custom Custom 


University projects 


For projects and data services covered by the current ABS/Universities Australia Agreement, students, staff and researchers 


are not individually invoiced for their use of the charged ABS data services. 


For more information refer to the ABS/Universities Australia Agreement (/statistics/microdata-tablebuilder/absuniversities- 


australia-agreement) . 


New projects may progress their access requests outside of the ABS/Universities Australia Agreement, and will be subject to 


access fees and charges as outlined on the DataLab (/statistics/microdata-tablebuilder/datalab) page. 


Additional non-standard access and service charges 


Non-standard charges apply to all projects for services that are not within the scope of the annual charge. Non-standard 
charges include access to SAS, Databricks, non-standard virtual machines and storage above one terabyte. Non-standard 
charges also apply to increased service levels, such as priority clearance and high service level. More information on non- 


standard access and services are in the tables below. 


Non-standard DataLab access charges 


Excluding Including 
GST GST 


Use of SAS $500 $550 
Non-standard virtual machines 


Annual charges per person per project 


Standard virtual machines are included in the annual charge and comprise machines up to and including the large size. 
Please refer to virtual machines (https://www.abs.gov.au/statistics/microdata-tablebuilder/datalab/using-your- 


workspace#virtual-machines) for further information on size. 


Access to non-standard virtual machines is subject to a minimum charge. Should analysts exceed their usage in dollar _ ne 
, ; , ame ; ; ; - é $1,700 (minimum) $1,870 (minimum) 
terms for their non-standard virtual machine within the financial year, access can continue subject to additional 


charges being applied. Usage is calculated per hour. Please see virtual machines (https://www.abs.gov.au/statistics/ 


microdata-tablebuilder/datalab/using-your-workspace#virtual-machines) for hourly rates. 


If shorter term usage of a non-standard virtual machine is required, please contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) to discuss options. 


Annual charges per project Excluding GST Including GST 


Databricks - low usage 


Databricks - high usage 
$3,500 (low usage $3,850 (low usage 


Please refer to Databricks (/statistics/microdata-tablebuilder/datalab/using-your-workspace#databricks) for Minimum) minimum) 


more information on this service. F 
$6,500 (high usage $7,150 (high usage 


The price of this access is a minimum charge. Should analysts exceed their usage in dollar terms for their ™inimum) minimum) 
access to Databricks within the financial year, access can continue subject to additional charges being 
applied. 


Each additional terabyte of storage 


7 : $850 $935 
One terabyte of storage is included in the annual charge. 


Non-standard DataLab service charges 


Excluding Including 


A Ich ject 
nnual charges per projec GST GST 


High output demand - Tier 1 
High output demand - Tier 2 


A high output demand charge applies to projects that require a higher level of service, including high volumes, faster 
turnaround or the application of special rules. This charge will be applied when the project team requests this higher 
level of service, or when the ABS determines that a project is requiring resources exceeding cost recovery of the 
annual charge. High output demand charges are structured into two separate tiers. 


Tier 1 applies to projects with output requests that: $19,000 (Tier 1) $20,900 (Tier 1) 


¢ regularly exceed 2 per month $41,000 (Tier 2) $45,100 (Tier 2) 
e regularly require turnaround of less than 48 hours, or 


e require informal ABS methodological or policy advice to facilitate output. 


Tier 2 applies to projects with output requests that: 


e regularly exceed weekly occurrences 
¢ regularly require same day turn around, or 


e require formal ABS methodological or legislative advice to facilitate output. 


High service level $20,000 $22,000 


A high service level charge applies to projects that require resources exceeding the cost recovery of the annual fee. 
This charge will be applied when the project team requests this higher level of service, or when the ABS determines 
that a project is requiring resources exceeding cost recovery of the annual charge. 


The following will be a factor in considering the application of the high service level charge: 


¢ frequent/regular meetings 


¢ frequent/complex queries 


Excluding Including 


A Ich ject 
nnual charges per projec GST GST 


¢ frequent/complex project changes 


high volume of publications requiring review and custodian notifications 


© projects with a large range of research topics requiring access to a high volume of datasets and data 
integration work 


=f 


© projects with custom requirements 


© projects with compressed timelines and critical milestones which prompt out-of-session arrangements and 
prioritisation within the ABS work program 


© projects with multiple phases with varied needs requiring staged custodian approvals, additional approvals 
such as non-DataLab approvals, and increased effort to monitor project status and progress 


© projects with non-s15 access, for example, s14 or s16, requiring additional arrangements 


© projects merging or splitting, thus requiring re-approvals and rearrangements 


Applying for DataLab access 
Step 1. Ensure you meet requirements 


For criteria, refer to Who can access the DataLab (HWho-can-access-the-DataLab) 


Organisation approval 


e Your organisation must have a verified Responsible Officer Undertaking (/statistics/microdata-tablebuilder/responsible- 
use-abs-microdata/undertakings-and-declarations#responsible-officer-undertaking) (ROU) in place with the ABS. If one 


does not exist, your organisation will not be available for selection in the myDATA online project proposal. 
¢ To check if there is an active ROU for your organisation, go to the myDATA user portal homepage and select Dashboard/ 
Organisation. 


Researcher approval 


e You must have a commitment to protect the confidentiality of data. 
e Every member of your project team who will see or discuss uncleared outputs (whether or not they will be using DataLab) 
needs to be approved. 


Project approval 


e Projects must be for statistical and/or research purposes and provide public benefit. 
e Projects must not be for compliance or regulatory purposes. 
e Every project needs to be approved by the ABS. 


e Projects for or about Aboriginal and/or Torres Strait Islander peoples may be subject to a Cultural Review by the Centre of 
Aboriginal and Torres Strait Islander Statistics at the ABS. 


e Some projects also require consideration and approval by data custodians. 


Refer to What is DataLab (/statistics/microdata-tablebuilder/datalab#what-is-datalab) and Using DataLab responsibly (/ 


statistics/microdata-tablebuilder/datalab/using-datalab-responsibly) for more information. 


Step 2. Register and activate your account 


Registration of an account will allow you to: 
* create a project proposal within the myDATA user portal 
¢ enrol in DataLab safe researcher training 


e collect forms for your onboarding process after training has been completed 


e draft and review projects you are participating in. 


Register in the myDATA Portal (https://mydataportal.abs.gov.au/) and agree to the Conditions of use (/statistics/microdata- 


tablebuilder/responsible-use-abs-microdata/conditions-use) 


e Use your organisation email address. If you are a user in more than one organisation, you will need to register separately 


using the email address for each organisation. 
e Authenticate your account - myDATA will automatically email your registered account with steps to authenticate. 


e If you encounter errors in myDATA, please submit a System support query (/statistics/microdata-tablebuilder/datalab/ 


contact-us#system-support) . 


You can complete your training while your project proposal is underway. 


Access will not be granted until DataLab safe onboarding is completed. For the onboarding process, the following documents 


are required to be submitted: 


e Individual Undertaking and DataLab Declaration of Compliance (/statistics/microdata-tablebuilder/responsible-use-abs- 
microdata/undertakings-and-declarations) 


e DataLab quiz 
e additional documents relevant to particular datasets, if requested by ABS 


e if you are not an experienced researcher, you may need to submit a DataLab Referral, please email 
data.services@abs.gov.au (mailto:data.services@abs.gov.au) to request this form. 


For further information, please refer to the myDATA user guide (/statistics/microdata-tablebuilder/datalab/getting-started- 


mydata) . 
Step 3. Submit project proposal 


Submit project proposal 


Create and complete a new project proposal in the myDATA 


Updates to an existing project proposal (word document 
user portal e id per ( ) 


; : . x f For existing projects, the project proposal must be updated with any changes 
The creator of a new project will be automatically assigned as the Project eas ; 
: a A ; (e.g., changes to researchers, organisations, data or scope) and submitted 
Editor, they are the only person who can edit and submit the project proposal. _ A 
to data.services@abs.gov.au (mailto:data.services@abs.gov.au) 


Project Leads can be identified separately when adding people to the project. 


. : . Changes to project proposals must be made in red, with tracked changes on, 
Step through the online form and complete all required fields. z : 
and supplied on the newest version of the template below. 


Submit your completed project proposal to the ABS for review, who will : 
i ; é . Project proposal template and data request form 
respond with feedback if edits are required. 


B ABS DataLab Data Request Form.xlsx (/statistics/microdata-tablebuilder/ 
attachments/ABS %20DataLab %20project% 20proposal%20- 
%20data% 20request% 20form%202024.03.2.xlsx) 


Note: researchers must complete registration and activation steps successfully 


before they can be added to the project. Training does not have to be 


completed to be added to a project - access will not be granted until after 
approval is given. B ABS DataLab Project Proposal.docx (/system/files/ 
documents/983791b886643c8c7031184b7e5d0dc8/ 
ABS%20DataLab%20Project%20Proposal%20for% 20Detailed%20and%20In 
tegrated % 20Data%20-%20Dec %202023.docx) 


For further information, please refer to the myDATA user guide (/statistics/ 


microdata-tablebuilder/datalab/getting-started-mydata) . 


Enabling access to DataLab 
DataLab is enabled by cloud infrastructure, which may be blocked by some organisations’ firewall settings. 


ABS cannot make changes to external organisations' infrastructure. Project Leads need to supply the information below to 


each organisation participating on this project. 


Network/IT Security sections in each organisation need to review and make changes to authenticate access. This only needs 


to be done once per organisation. 
Azure Virtual Desktop configuration 
1. Enable authentication to the tenant 


Users need to authenticate to one of ABS Azure Active tenants, which may be strictly controlled by government agencies and 


academic workplaces. Authentication must be enabled to the tenant: 
e absmydata.onmicrosoft.com 


This tenant is in the Azure Australia East and Azure Australia Central regions. 


2. Allow user access to URLs 
Users will need to access the following URLs: 
e DataLab production portal: datalab.abs.gov.au and sead.abs.gov.au 


3. Configure your organisation's network to allow outbound connections to the following addresses required for Azure Virtual 
Desktop (AVD): 


e login.microsoftonline.com 
e *wvd.microsoft.com 

e *servicebus.windows.net 
© go.microsoft.com 

e aka.ms 

e learn.microsoft.com 

° privacy.microsoft.com 


e query.prod.cms.rt.microsoft.com 
These addresses all utilise the TCP protocol and outbound port 443 for communication. 


Contact data.services@abs.gov.au (mailto:data.services@abs.gov.au) for further assistance. 


Accessibility and inclusiveness 


The ABS is actively working to comply with Web Content Accessibility Guidelines (https://www.w3.org/TR/WCAG21/) (WCAG) 


2.1 at Level AA, which describe how to make web content more usable and accessible for everyone. Our goal is to provide 


information that is accessible to all, including people with disabilities. 


Recent accessibility reviews confirm that the DataLab/SEAD cloud platform meets the necessary organisational standards as 
it: 


e runs on Windows 11, which enables the utilisation of existing accessibility features and functions 
e utilises virtual machines that are subject to Microsoft compliance obligations 


¢ contains statistical tools that are either WCAG compliant or provide integration with Windows Accessibility features 


Note: Any Windows accessibility features not enabled by default can be requested, and will be considered in line with 


relevant data sensitivities. 


Privacy policy 


The ABS privacy policy (/about/legislation-and-policy/privacy/privacy-abs#About) and DataLab privacy notice (/about/ 


legislation-and-policy/privacy/datalab-privacy-notice) outline how the ABS handles any personal information that you provide 


to us. 
Getting started in myDATA 


myDATA is a one-stop-shop for managing research projects in the DataLab 


Released 20/07/2022 
Activate your account 


Registration: (https://mydataportal.abs.gov.au/) after signing up with your organisational email address, you will be sent two 


emails 


1. Welcome to myDATA, from ABS 


2. Activate your ABS account, from Okta 
Activation: Click the 'Activate ABS Account' button in the Okta email to complete the account activation process. 


Troubleshooting: If you don't receive the email within an hour, check your spam folder. 


Expiration: The activation email link is valid for 7 days. If you miss this window, contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) for a new activation email. 


Dashboard Access: Once authenticated, logging in (https://mydataportal.abs.gov.au/) will redirect you to the myDATA 


dashboard. Visit Navigating the Dashboard (/statistics/microdata-tablebuilder/datalab/getting-started-mydata-do-not- 


publish#navigating-the-dashboard) for next steps. 


Note 


¢ Personal email addresses (for example @hotmail) cannot be verified, use your organisation email address. 


e If your organisation is not registered with myDATA, please contact data.services@abs.gov.au 
(mailto:data.services@abs.gov.au) to arrange next steps. 


e During registration you can skip Registration Centre User ID if you do not have this ID or cannot remember it. 


e Your DataLab account will be created by the ABS once you have completed training requirements and have been approved 
to join a project proposal. 


Open the Okta activation email and select 'Activate ABS Account’, the link will open in your default browser. 


Select Password 'Set up' first. 


Security methods help protect your Okta account 


by ensuring only you have access. 


Set up required 


¥ Google Authenticator 


Enter a temporary code generated from 
the Google Authenticator app. 
Used for access 


WY 
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& Password 


OO 
Choose a password for your account 


Used for access 


Ww 


etup 


Back to sign in 


After setting up your password, your browser will prompt you to complete the remaining security method. 
Before proceeding, download the Google authenticator App on your mobile device. 


The App Developer is Google LLC. This is a free App that does not have in App purchases. Credit card details are not 
required. 


Apple App Store (https://apps.apple.com/us/app/google-authenticator/id388497605) 


Google Play Store (https://play.google.com/store/apps/details?id=com.google.android.apps.authenticator2&hl=en&gl=US) 


Now you have the Google authenticator App on your mobile device. 


Return to your computer browser session with the remaining set up security method step 


Select Google Authenticator 'Set up'. 


Security methods help protect your Okta account 


by ensuring only you have access. 


Set up required 


% Google Authenticator 


Enter a temporary code generated from 
the Google Authenticator app. 
Used for access 


Set up 


Back to sign in 


The link will open a page similar to below. Follow the prompts using your Google Authenticator App on your mobile device, tap 
the + icon and then select scan barcode. 


Scan barcode 


Launch Google 
Authenticator, tap the 
"+" icon, then select 
"Scan barcode". 


Can't scan? 


Return to authenticator list 


Back to sign in 


After scanning the barcode you will be prompted to enter the code from the Google Authenticator App. Enter the code and 


verify. 
Follow the on-screen prompts which repeat your security settings 


1. Registered email 
2. Password 


3. Google authenticator app code 
Now you have activated, and you will see a ‘Your account is almost ready!' page. 


After a few minutes, refreshing your browser will display your registered profile. Check over the fields, update if needed and 


then Submit. 


You are now activated in the myDATA user portal and will see the Dashboard. 


Navigating the dashboard 


Australian 


Bureau of Dashboard | & My Account - 
Statistics 


(2) (3) 
Dashboard 


‘ (4)i| , (5) , (6) 


My profile My organisation My onboarding 


View and update your personal details Information about my organisatior Become DataLab ready by attending training 


and completing individual forms 


My projects Data Catalogue Change Requests 
Create, edit and submit DataLab projects. As See what detailed microdata is available for List of my change requests 
vell as track your submissions progress. Project proposal submission 
a a 


There are a number of useful features on the Dashboard 


1. ABS and myDATA logos will take you to the corresponding home page. 
2. myDATA breadcrumb aids navigation. You can use the breadcrumb to jump through pages. 


3. My Account is where you can log out of the myDATA system. If you are inactive for more than 30 minutes you will be 
automatically logged out. 


4. My profile tile will display your registered information. You can update most fields at any time. If you need to change your 
email you will need to contact data.services@abs.gov.au (mailto:data.services@abs.gov.au) . 


5. My organisation tile shows which organisation you are attached to. 


6. My onboarding tile is where you can enrol and cancel your DataLab Safe Researcher training, review your training session 
details, and find your pre-training reading material, as well as access onboarding forms/quiz after training is completed. 


7. My projects tile is where you can create, edit and submit a new DataLab project proposal. As well as track your project 
proposals progress. You will see all project proposals you have been added to on this tile. Only the Project editor can edit 
detail within the project proposal. 


8. Data catalogue tile shows what detailed microdata is available for your project proposal submission. You can sort and 
search for data in this view to understand what data selection is appropriate for your project proposal. 


9. Change Requests is where you can request draft and submit project proposal changes. 


Training and onboarding 
Enrolling in a training session 


From the My onboarding tile, select the Enrol in training button. 


My onboarding - Enrolled training 


Training sessions are shown in local time zones, and do not reflect daylight saving time if observed. 
Enrolled training 


Session period 


Completed training 
3 Training venue Session date Enrolment Status 


Forms and quiz 


There are no records to display 


Select the magnifying glass to bring up the list of available sessions, and choose your preferred session by ticking the box on 
the left. 


Confirm your action by clicking Select. 


Lookup records 


ing s& re shown ir € zones, and do not reflect da ir ne if observe Q 
7 = Training Course Session Date Session start time Session end time ! 
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You will be shown a preview of the session details. 
Click ‘Submit’ and then ‘Ok’ to confirm. The Enrolled training table will now be updated with your session date and time. 


You will receive an email with the training session details, including a Zoom link for a virtual session, and physical training 


address for face-to-face. 


If you need to Cancel your enrolment, select the drop down arrow to the right of the table row and click Cancel and then 


Confirm. 


To re-enrol, repeat Enrol in training steps above. 


My onboarding - Enrolled training 


Training sessions are shown in local time zones, and do not reflect daylight saving time if ob: 


ved, Enrol in training 


Enrolled training 
Completed training Session period Training venue Session date Enrolment Status 
e ; DataLab Safe Researcher Training Canberra, ABS House. 18/04/2023 Enrolled ic] 
‘orms and quiz 
q Canberra - 18/04/2023 Knibbs Auditorium, 45 - 
Benjamin Way es 
Belconnen ACT 2617 Cancel 


Waitlisting - If no sessions are suitable 


If the training sessions listed are not suitable, you can elect to be placed on a waitlist. Click ‘No session suitable’ button. 


Lookup records 
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Check back periodically to see what new training sessions are available. 
When a session is advertised that fits your schedule then cancel the waitlisting enrolment and enrol in the training session. 


After enrolling in a DataLab Safe Researcher training session, you will automatically have access to the pre-training reading 


material. 


This is available from the Forms and quiz view of the My onboarding table. 


My onboarding - Enrolled training 


Training sessions are shown in local time zones, and do not reflect daylight saving time if observed Enrol in training 


Session period T Training venue Session date Enrolment Status 


Enrolled training 


Completed training 


DataLab Safe Researcher Training Canberra, ABS House. 18/04/2023 Enrolled v 
Canberra - 18/04/2023 Knibbs Auditorium, 45 


Benjamin Way 


Belconnen ACT 2617 


Onboarding forms are only available after training is complete. 


You will be notified by email when your onboarding forms and quiz are available for you to download. You will find these in the 


same place as the pre-training reading material - the Forms and quiz view of the My onboarding table. 


Within the Forms and quiz section, you are able to download your document/s, click the arrow to the right of the row, and 
select View. 


My onboarding - Forms and quiz 


Enrolled training Response Agree to 
Form t type Signed By Signed Date Terms 
Completed training 
DataLab safe researcher training pre- Downloaded No a 


Select the file and save it to your computer. 


When the forms and quiz are complete, return to data.services@abs.gov.au (mailto:data.services@abs.gov.au) for review. 


If completed correctly your table view will update with further details, for example signed date. 


Development is underway to upload forms and complete forms online from the user portal. We expect this functionality will be 
available at the end of 2024, or early 2025. 


Thank you for being patient while we complete this development. 

DataLab project proposal 

Creating and editing 

Any portal user who meets the following criteria can create a Project proposal, 


e has an Active myDATA account, and 


¢ belongs to an organisation with an active Responsible Officer Undertaking (https://www.abs.gov.au/statistics/microdata- 
tablebuilder/responsible-use-abs-microdata/undertakings-and-declarations#responsible-officer-undertaking) 


The researcher creating the project proposal will automatically be set as the Project editor. The Project editor is the only 


person who can edit the project proposal. All researchers added to the project proposal will be able to read, but not edit. 


The Project editor is usually the Project lead, however the role to draft, edit, submit and maintain the project proposal can be 


delegated to another researcher, if this best suits your research team. 


The role of Project editor can be passed to another researcher when the project proposal is in Draft status. After the project 
proposal moves to Active status, then a change request will need to be submitted to change the Project editor. If the Project 
editor who is leaving the role is not listed as a analyst or discussant on the project proposal, they will no longer be able to 


read/access the project proposal until the new Project editor adds them to the project proposal. 


If the Project lead assigns responsibility to a Project editor, they are also agreeing this Project editor has the same 


responsibilities, delegations and authority on the project proposal. 


Draft, Submit, Feedback 


Project proposals start in a Draft status, and when all fields have been filled the project proposal can then be submitted to the 


ABS for review. At this point the project proposal shifts to Submitted status and cannot be edited by the Project editor. 


ABS teams will review your content to ensure the project meets requirements (https://www.abs.gov.au/statistics/microdata- 


tablebuilder/datalab#applying-for-datalab-access) . Sometimes there will need to be changes or more detail provided. If this 


is required, feedback will be added to the Project proposal and a information box will display at the top of each project 


proposal page. 


There is feedback provided on this page. Click here to view. 


Feedback Acknowledgment: When feedback is given, acknowledge it. Once acknowledged, the information box won't appear 


anymore. 
Reply Option: If necessary, you can reply to the feedback. 


Project Proposal Cycle: The project proposal goes through a cycle of drafts, submissions, and feedback until it meets its 


intended purpose. 
Autosave 
While the Project editor is drafting the project proposal saving will happen automatically when: 


1. moving to the next page (Save & Next button), or 


2. after 5 minutes of inactivity. 
If changes are made and the Previous button is selected - changes will not be saved! 


When the autosave has run after inactivity a information box will display. 


This page was was autosaved on 6:51:37 pm 


Time out 


If myDATA is inactive for 30 minutes or more you session will time out. Log in again using your email, password and 


authentication code. 
Project proposal 
The project proposal is grouped into parts 


e Access considerations 
e Project details 

e Project objectives 

e People 

e Data 

e Output 

e Attachments 


e Submit 


You can only navigate through the project proposal one page at a time, from the Previous or Save & Next buttons. These are 


located at the top and bottom of each page. 


Each project proposal field has been set up to capture specific requirements, and may have response questions that are 


mandatory for your situation. 


If you do not fill in a mandatory field, when you try to move to the next page a warning box will appear highlighting what is 


missing. You can use the link in the warning box to jump to the field and complete what is required. 


When the project proposal has been submitted the project proposal will move to the My projects - Pending table and is locked 


from editing. 


If you need to recall the project back to draft, please email data.services@abs.gov.au (mailto:data.services@abs.gov.au) . 


@ The form could not be submitted for the following reasons: 


Project outcomes is a required field. 


Adding people 
People can only be added 


1. from organisations with an active Responsible Officer Undertaking (https://www.abs.gov.au/statistics/microdata- 
tablebuilder/responsible-use-abs-microdata/undertakings-and-declarations#responsible-officer-undertaking) 


2. after the person has successfully activated their user profile. 


From the People page of the project proposal you will first need to add the organisation/s to the Stakeholders section. This is 


broken down into 


e Lead organisation: usually the organisation from which the Project Lead belongs to 
e Member organisations: drives the project researchers who can belong to the project proposal 


e Government organisation sponsor: lists out the Government organisations, if the project is being sponsored 
When the organisation/s have been added, you will be able to add Project researchers. 
After adding people to the Project researchers table, you can Edit or Remove Project researchers from each row action menu. 


Data 
Data catalogue 


From the Dashboard there is a Data catalogue tile which displays all the available Data packages. 


Further details describing the Data packages or Datasets are available from the action menu, to the right side of each row. Or 
you can jump directly to the Data package description by selecting the Data package name. Further web content can be 


accessed from the Product information link (if provided). 
The catalogue aims to help you with your data selection before starting a project proposal. 


When it is known what data will be required, take note of the Data asset and Dataset categories, as these are used to filter 


data selections within the project proposal. 


Adding data to the project proposal 
When adding data to the project proposal you must focus your selection by selecting 


e Data asset 


e Dataset 
This will refine what Data packages are then displayed for selection. 


When selecting the Data package you may be asked for a Justification. This is a mandatory field and your selection will not 


proceed until provided. 


You can select all Data packages within the dataset category, or one to many Data packages by ticking the corresponding 


box. A selection must be made before you can proceed. 


Data can be removed from the Standard DataLab Product table by clicking the action menu on that row and selecting Remove. 


By confirming your action, the Dataset will be removed. 


Data packages 


Data package _ 
Selectall | | 


ATO Client Register 2006 - latest 


Data Linkage Request 


If anew Data Linkage Request is needed, select the Add button from the corresponding table. This will present a input form, 


follow the prompts and then submit the form. 
When the project proposal is submitted, the ABS teams will review your request and follow up to seek additional information. 


While the project proposal is in Draft status, you can edit or remove the entry from the action menu. After the project proposal 


is Active you cannot edit or remove, and contact will need to be made with data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) for either action. 


After the project proposal is Active, your new data linkage request may still be under development. Progress can be monitored 


from the Project proposal overview. 
Other data 
If you require data not covered by existing catalogues, including subsets of existing data and requests to load other un-linked 


data (including aggregate data) to your DataLab project, you will need to provide as much detail as possible. 


ABS strongly encourages the use of the PLIDA and BLADE Modular products. These provides optimal flexibility for analysing 


data and are typically delivered to projects in a timely manner than a customised subset. 


Customised subsets of a PLIDA dataset should only be requested when there are extenuating circumstances preventing the 


provision of the corresponding modules in the PLIDA Modular Product. 


If you have any questions, please contact data.services@abs.gov.au (mailto: % 20data.services@abs.gov.au) . 


Attachments 


For now, attachments must be sent to data.services@abs.gov.au (mailto:data.services@abs.gov.au) . The ABS admins will 


attach the file to your project proposal and you will see the file from this page. 


Upcoming development will provide the ability for portal users to upload attachments from the myDATA user portal. This 


content will be updated when functionality is released. 
Change requests 
From the Change request tile any project researcher can request two types of change for their Active project: 


e Organisations and People: The requester can add new organisations and researchers or remove organisations and 
researchers from their project. 


e Project Details: The requester can change the project details including the project title, scope, data, objectives and 


outcomes, ethics and sensitive data sections and the project end date 


It can take up to 20 minutes for the change template to be generated. There can be only one change request of each type in 


draft or pending status. 


When the change template has been generated it will be available in the My Change Requests - Draft table, and only the 


project editor can make changes. All active project researchers will be able to view the change, but not edit the content. 


Change requests go through the same cycle as the project proposal. When the change has been approved the updates will be 


made to the active project proposal. 


If you need to make changes to a change request that has been submitted, email data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) (citing project number and title). 


New Data Linkage Requests can be submitted from a change request, but an existing data linkage request cannot be edited. 


To edit or remove a data linkage request email data.services@abs.gov.au (mailto:data.services@abs.gov.au) . 


Project closure 
Email reminders are sent to all active project researchers on the project, at: 


e 2 months from expected end date 


¢ 1 month from expected end date. 
At this point the Project editor can choose to 


e extend the expected end date from a change request 


e confirm the project is closing 


After confirming the project is closing we have some survey questions to help inform our future development. Thank you in 


advance for providing your responses. 


If project closure is confirmed, we will remove access in DataLab the following day, and your Project proposal will move to My 


projects - Closed. 


Project overview 


The project proposal overview provides a snapshot of who and what can be accessed, contact details for researchers, and 


status for 


© project 
e researchers 
e data packages 


e change requests 
Access in DataLab to any of the above items only happens when the status is Active. 


Data Linkage Requests develop independently from the Project Proposal, and can also be tracked from the Overview page. 
When their status has been set to Approved the data will be added to your Project Proposal. When the Data package is listed 


as Active you will have access in DataLab. 


To open a project proposal overview select the Project ID link from the My projects table. Or when you are viewing the project 


proposal content, at the top right of the page select, 'go to Project overview'. 


The project proposal overview shows different status views for Researchers and Data tables. Toggle between views by 


selecting the type of status you want to see: 


e Active 
e Removed 


e Pending 


Do not talk or share! 


Only Active researchers can discuss unvetted data from this project. 


Researchers listed on the Removed or Pending tables are NOT allowed to discuss until they are listed as ACTIVE on the 


project proposal. 
Project proposal statuses 


Portal user account 


e Not yet active: portal user has completed registration, but has not activated their account. 


e Active: portal user has activated their account, and can access the myDATA Dashboard. 
Portal user DataLab readiness 


e Training required: portal user must select a DataLab Safe Researcher training session. 
e Enrolled: portal user has successfully enrolled into a DataLab Safe Researcher training session. 


e Forms pending: portal user has attended DataLab Safe Researcher training and now must complete the forms (Individual 
Undertaking etc.) and quiz. 


e Onboarding complete: portal user has completed DataLab Safe Researcher training, all forms and passed the quiz. 


The project proposal brings together the scope, data and people into one application. The project goes through the following 


status 


e Draft: Project editor is forming the content. 


e Submitted: ABS is reviewing content. ABS may supply feedback and reset project proposal to Draft, if content does not 
meet intended purpose. 


e Under assessment: ABS governance teams are assessing the project against the 5 safes framework to support the 
approval request. 


e Pending approval: the project proposal and supporting assessment are sent to approvers for decision. 
e Approved: approval has been granted. 


e Active: access is now available in DataLab. 
Troubleshooting 
My password isn't working 
If your password is not working, try the 'Forgot password link' available below the password box. This will send you an email. 


Select the link 'Enter a verification code instead’, and from the email 'Account password reset', locate the code and enter it to 


your browser session. 
You can now create a new password. 


One time code not appearing on authenticator 


Please ensure you are using the correct Google Okta authentication App. If you are unsure contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) . 


Stuck on 'Your account is almost ready' page 
If after authentication is set up and you are not seeing the myDATA dashboard try (one or many of) the following: 


Press Ctrl F5 


e Clear your browser cache, delete cookies, close browser and try to log in again 
e Try anew browser session in private mode (Edge Settings 'New InPrivate window') 


e Try a different browser, recommended browsers are: 
e¢ Google Chrome, latest three major releases 


e Microsoft Edge, latest three major releases 
e Mozilla Firefox, latest three major releases 


e Apple Safari, 13 or later 
How do | know where my project proposal application is up to? 


Each project proposal goes through various status throughout the application and approval processes. Status can be 


monitored from the Overview (/statistics/microdata-tablebuilder/datalab/getting-started-mydata-do-not-publish#project- 


overview) page. 


How do I make changes to the project proposal? 


Project proposals can only be edited while in Draft status by the Project Editor. If the Project Editor is unavailable or needs to 


be changed on the project proposal, please contact data.services@abs.gov.au (mailto:data.services@abs.gov.au) and we can 


update this for you. 
Why can't! add more text to my project proposal? 


All fields which have formatting tools (rich text) will allow 32,000 characters, however using the formatting tools will introduce 
hidden HTML tags within the field and will count towards the overall character limit. 


Some fields do not have formatting tools, and cannot include formatting, for now these fields have a limit of 2,000 characters. 
Over time we will update these fields to rich text fields. 


The title field has a limit of 100 characters. 
Why did I get logged out of myDATA? 


Sessions that are inactive for 30 minutes or more will be timed out of their active session. If you have a project proposal 


underway the autosave function will save your last input. 
Products 


List of detailed microdata files available in DataLab, links to publications and data item lists 


Released 8/11/2021 
Detailed microdata files and reference periods in DataLab are listed below. For datasets in other systems see 


MicrodataDownload (/statistics/microdata-tablebuilder/microdatadownload/topics) and TableBuilder (/statistics/microdata- 


tablebuilder/tablebuilder/topics) , or all topics in Available microdata and TableBuilder (/statistics/microdata-tablebuilder/ 


available-microdata-tablebuilder) . 


You need to apply for access by submitting a DataLab project proposal (/statistics/microdata-tablebuilder/datalab#applying- 


for-and-using-datalab) before you can access these files. 


Use Ctrl+F (Windows) or Command+F (Mac) to search this list. 
Economy 


Business Longitudinal Analysis Data Environment (BLADE) (/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/business-longitudinal-analysis-data-environment-blade) 


Business Characteristics, 2004-05 to 2009-10, 2006-07 to 2010-11, 2008-09 to 2012-13, 2009-10 to 2013-14, 2010-11 to 
2014-15, 2011-12 to 2015-16 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/business-characteristics- 


australia) 


Innovation in Australian Business, 2003 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/8158.0.55.002Main+Features12003?O0penDocument) 


Management and Organisational Capabilities of Australian Business, 2015-16 (/statistics/microdata-tablebuilder/available- 


microdata-tablebuilder/management-and-organisational-capabilities-australian-business) 


Environment 


Household Energy Consumption, 2012 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/household-energy- 


consumption) 


Health 


Australian Health Survey, Core Content - Risk Factors and Selected Health Conditions, 2011-12 (https://www.abs.gov.au/ 
ausstats/abs@.nsf/Lookup/4324.0.55.003main+features12011-12) 


Disability, Ageing and Carers, 2015 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4430.0.30.002Main+Features12015) 


Disability, Ageing and Carers, 2018 (https://www.abs.gov.au/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/disability-ageing-and-carers-australia) 


Mental Health and Wellbeing, 2007, 2020-21, 2020-2022, 2021-2022 (/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/national-study-mental-health-and-wellbeing) 


Mortality, Enhanced Characteristics, 2011-12 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/mortality- 


enhanced-characteristics-australia) 


National Aboriginal and Torres Strait Islander Health Survey, 2004-05 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4715.0.55.002Main+Features12004-05?0penDocument) 


National Aboriginal and Torres Strait Islander Health Survey, Core Content - Risk Factors and Selected Health Conditions, 
2012-13 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4715.0.30.003Main+Features12012-13) 


National Aboriginal and Torres Strait Islander Health Survey, Detailed Conditions and Other Health Data, 2012-13 (https:// 
www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4715.0.30.001Main+Features12012-13) 


National Aboriginal and Torres Strait Islander Health Survey, Nutrition and Physical Activity, 2012-13 (/statistics/microdata- 


tablebuilder/available-microdata-tablebuilder/australian-aboriginal-and-torres-strait-islander-health-survey-nutrition-and- 


physical-activity) | 


National Aboriginal and Torres Strait Islander Health Survey, 2018-19 (/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/national-aboriginal-and-torres-strait-islander-health-australia) 


National Aboriginal and Torres Strait Islander Social Survey, 2002 (/AUSSTATS/abs@.nsf/ 
Lookup/4720.0Main+Features12002?O0penDocument) 


National Aboriginal and Torres Strait Islander Social Survey, 2008 (/AUSSTATS/abs@.nsf/ 
Lookup/4720.0Main+Features12008?O0penDocument) 


National Aboriginal and Torres Strait Islander Social Survey, 2014-15 (/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/national-aboriginal-and-torres-strait-islander-social-survey) 


National Aboriginal and Torres Strait Islander Survey, 1994 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4188.0.55.003Main+Features11994 % 20(Reweighted)?O0penDocument) 


National Health Indigenous, 2001 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4715.0.55.002Main+Features12001? 


OpenDocument) 


National Health Survey, 2001 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4324.0Main+Features12001? 


OpenDocument) 


National Health Survey, 2004-05 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4324.0Main+Features12004-05? 


OpenDocument) 


National Health Survey, 2007-08 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4324.0Main+Features12007-08? 


OpenDocument) 


National Health Survey, 2011-12 (https://www.abs.gov.au/ausstats/abs@.nsf/Lookup/4324.0.55.001main+features12011-12) 


National Health Survey, 2014-15 (https://www.abs.gov.au/ausstats/abs@.nsf/Lookup/4324.0.55.001main+features12014-15) 


National Health Survey, 2017-18, 2020-21, 2022 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/national- 


health-survey) | 


Nutrition and Physical Activity, 2011-12 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/australian-health- 


survey-nutrition-and-physical-activity) 


Patient Experiences, 2018-19, 2019-20, 2020-21, 2021-22, 2022-23 (/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/patient-experiences-australia) 


Smoker Status, 2017-18, 2020-21, 2021-22 (https://www.abs.gov.au/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/smoker-status) 


Labour 


Australians' Employment and Unemployment Patterns, 1994-97 (https://www.abs.gov.au/ausstats/abs@.nsf/ 
PrimaryMainFeatures/6286.0.55.002?O0penDocument) 


Employee Earnings and Hours, 2006, 2010, 2012, 2014, 2016, 2018, 2021 and 2023 (https://www.abs.gov.au/statistics/ 


microdata-tablebuilder/available-microdata-tablebuilder/employee-earnings-and-hours-australia) 


Employee Earnings and Jobs, 2011-12 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/6311.0.55.001Main+Features12011-12) 


Employment Arrangements and Superannuation, 2000 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/6361.0.55.002Main+Features12000?OpenDocument) 


Employment Arrangements, Retirement and Superannuation, April to July 2007 (httos://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/6361.0.55.002Main+Features1April%20To% 20July %202007?0penDocument) 


Labour Force Survey and Employee Earnings Benefits and Trade Union Membership, 2006 (https://www.abs.gov.au/ 
AUSSTATS/abs@.nsf/allprimarymainfeatures/OB9B8BF33CC4DDA0CA2575EC00160566?0pendocument) 


Labour Force Survey and Employee Earnings Benefits and Trade Union Membership, 2008 (https://www.abs.gov.au/ 
AUSSTATS/abs@.nsf/allprimarymainfeatures/35F1014CCF28C89CCA2578F700129850?0pendocument) 


Labour Force Survey and Employee Earnings Benefits and Trade Union Membership, 2010 (https://www.abs.gov.au/ausstats/ 
abs@.nsf/PrimaryMainFeatures/6202.0.30.002?0penDocument) 


Labour Force Survey and Forms of Employment Survey, 2008 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/6202.0.30.008Main+FeaturesINov%202008?O0penDocument) 


Labour Force Survey and Labour Mobility, 2008 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
allprimarymainfeatures/562B355D5525933ECA2577F 40006EFFB?0pendocument) 


Labour Force Survey and Labour Mobility, 2010 (https://www.abs.gov.au/ausstats/abs@.nsf/ 
PrimaryMainFeatures/6202.0.30.004?0penDocument) 


Labour Force Survey and Labour Mobility, 2012 (https://www.abs.gov.au/ausstats/abs@.nsf/ 
PrimaryMainFeatures/6202.0.30.004?0penDocument) 


Longitudinal Labour Force, monthly data from 1982 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


longitudinal-labour-force-australia) , includes the following supplementary survey data: 


- Barriers and Incentives to Labour Force Participation, Australia (/statistics/labour/employment-and-unemployment/barriers- 


and-incentives-labour-force-participation-australia/latest-release) 


- Characteristics of Employment, Australia (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


characteristics-employment-australia) 


- Labour Force Status of Families (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/labour-force-status- 


families) 


- Participation, Job search and Mobility, 2015-2022 (/statistics/labour/employment-and-unemployment/participation-job- 


search-and-mobility-australia/latest-release) 


- Work-Related Injuries, 2009-10 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/work-related-injuries) 


Pregnancy and Employment Transitions, 2005, 2011 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


pregnancy-and-employment-transitions-australia) 


Qualifications and Work, 2018-19 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/qualifications-and-work) 


People 


Adult Literacy and Life Skills, 2006 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
allprimarymainfeatures/6E7BE16152ABOD40CA257B12000F64D9?0pendocument) 


Australian Census and Migrants, 2011, 2016, 2021 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


permanent-migrants-australia) 


Australian Census and Temporary Entrants, 2016, 2021 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


temporary-visa-holders-australia) 


Australian Census Longitudinal Dataset, 2006-2011, 2006-2021, 2011-2021, 2016-2021 (/statistics/microdata-tablebuilder/ 


available-microdata-tablebuilder/australian-census-longitudinal-dataset) 


Census of Population and Housing, 2001 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/2037.0Main+Features12001? 


OpenDocument) 


Census of Population and Housing, 2006 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/2037.0Main+Features12006? 


OpenDocument) 


Census of Population and Housing, 2011 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/2037.0.30.001Main+Features12011) 


Census of Population and Housing, 2016, 2021 (https://www.abs.gov.au/statistics/microdata-tablebuilder/available-microdata- 


tablebuilder/census-population-and-housing) 


Characteristics of Recent Migrants, 2007 and 2010 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


characteristics-recent-migrants) 


Child Care, 1999 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4402.0.55.002Main+Features1Jun % 201999? 


OpenDocument) 


Child Care, 2002 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4402.0.55.002Main+Features1Jun%202002? 


OpenDocument) 


Child Care, 2005 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4402.0.55.002Main+Features1Jun% 202005 %20(Reissue)?OpenDocument) 


Childhood Education and Care, 2008 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4402.0.55.002Main+Features1June%202008?O0penDocument) 


Childhood Education and Care, 2011 (https://www.abs.gov.au/ausstats/abs@.nsf/ 
Lookup/4402.0.55.001Main+Features1June+2011) 


Crime and Safety, 2002 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4509.0.55.001Main+Features12002? 


OpenDocument) 


Crime and Safety, 2005 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4509.0.55.003Main+Features12005? 


OpenDocument) 


Crime Victimisation, 2009-10 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4530.0.55.001Main+Features12009%E2%80%9310?0penDocument) 


Education and Training, 2005 (https://www.abs.gov.au/ausstats/abs@.nsf/PrimaryMainFeatures/6278.0.55.001? 


OpenDocument) 


Education and Training, 2009 (https://www.abs.gov.au/ausstats/abs@.nsf/PrimaryMainFeatures/6278.0.55.001? 


OpenDocument) 


Education and Work, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2022, 2023 (/statistics/microdata-tablebuilder/ 


available-microdata-tablebuilder/education-and-work-australia) 


Family Characteristics and Transitions, 2006-07 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4442.0.55.002Main+Features12006-07?0penDocument) 


Family Characteristics, 2003 (https://www.abs.gov.au/AUSSTATS/abs@.nst/ 
allprimarymainfeatures/521BDBD87EB2CF5CCA25745F00168C3B?0pendocument) 


Family Characteristics, 2009-10 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4442.0.55.001Main+Features12009-10) 


General Social Survey, 2002 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4159.0.55.002Main+Features12006? 


OpenDocument) 


General Social Survey, 2006 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4159.0.55.002Main+Features12006? 


OpenDocument) 


General Social Survey, 2010 (General Social Survey, 2010) 


General Social Survey, 2014 (https://www.abs.gov.au/statistics/microdata-tablebuilder/available-microdata-tablebuilder/ 


general-social-survey-australia) 


Household Expenditure, Income and Housing, 2003-04 including Fiscal Incidence Study (https://www.abs.gov.au/AUSSTATS/ 
abs@.nsf/Lookup/6540.0Main+Features12003-04+(Third+Edition)) 


Household Expenditure, Income and Housing, 2009-10 including Fiscal Incidence Study (https://www.abs.gov.au/AUSSTATS/ 
abs@.nsf/Lookup/6540.0Main+Features12009-10+Third+Edition) 


Household Expenditure, Income and Housing, 2015-16 including Fiscal Incidence Study (https://www.abs.gov.au/AUSSTATS/ 
abs@.nsf/Lookup/6540.0Main+Features12015-16) 


Income and Housing, 2000-01, 2002-03, 2003-04, 2005-06, 2007-08, 2009-10, 2011-12, 2013-14, 2015-16, 2017-18, 2019-20 


(/statistics/microdata-tablebuilder/available-microdata-tablebuilder/income-and-housing-australia#data-downloads) 


Person Level Integrated Data Asset previously known as Multi-Agency Data Integration Project (MADIP), 2011-2016 (/ 


statistics/microdata-tablebuilder/available-microdata-tablebuilder/multi-agency-data-integration-project-madip) 


Multipurpose Household Survey, 2004-05, (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4100.0Main+Features12005-06?O0penDocument) includes the following: 


- Household Use of Information Technology 
- Barriers and Incentives to Labour Force Participation 
- Retirement and Retirement Intentions 


Multipurpose Household Survey, 2005-06 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4100.0Main+Features12006-07?0penDocument) , includes the following: 


- Household Use of Information Technology 

- Participation in Sports and Physical Recreation 

- Attendance at Selected Cultural and Leisure Venues and Events 
- Sports Attendance 

- Work-Related Injuries 


Multipurpose Household Survey, 2006-07 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4100.0Main+Features12006-07?0penDocument) , includes the following: 


- Adult Learning 

- Barriers and Incentives to Labour Force Participation 
- Retirement and Retirement Intentions 

- Household Use of Information Technology 

- Family Characteristics and Transitions 


Multipurpose Household Survey, 2007-08 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4100.0Main+Features12007-08?O0penDocument) , includes the following: 


- Environmental Views and Behaviour 
- Household Use of Information Technology 
- Personal Fraud 


Multipurpose Household Survey, 2008-09 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4100.0Main+Features12008-09?0penDocument) , includes the following: 


- Crime Victimisation 

- Barriers and Incentives to Labour Force Participation 
- Retirement and Retirement Intentions 

- Household Use of Information Technology 


Outcomes from Vocational Education and Training in Schools, 2006-2011 (https://www.abs.gov.au/statistics/microdata- 


tablebuilder/available-microdata-tablebuilder/outcomes-vocational-education-and-training-schools-australia) 


Participation in Sport and Physical Recreation, 2009-10 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4177.0.55.001Main+Features12009%E2%80%9310?0penDocument) 


Participation in Sport and Physical Recreation, 2011-12 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
Lookup/4177.0Main+Features12011-12) 


Personal Fraud, 2007-08 (hittps://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4528.0.55.002Main+Features12007? 


OpenDocument) 


Personal Income of Migrants, annually from 2009-10, 2010-11, 2011-12, 2012-13, 2014-15, 2015-16, 2016-17 (https:// 


www.abs.gov.au/statistics/microdata-tablebuilder/available-microdata-tablebuilder/personal-income-migrants-australia) 


Personal Safety Survey, 2005 (https://www.abs.gov.au/ausstats/abs@.nsf/PrimaryMainFeatures/4906.0.55.002? 


OpenDocument) 


Personal Safety, 2012, 2016 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/personal-safety-australia) 


Preschool Education, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, 2023 (https:// 


author.absweb.aws.abs.gov.au/statistics/microdata-tablebuilder/available-microdata-tablebuilder/preschool-education- 


australia) 


Programme for the International Assessment of Adult Competencies, 2011-12 (/statistics/microdata-tablebuilder/available- 


microdata-tablebuilder/programme-international-assessment-adult-competencies-australia) 


Time Use, 1997 (https://www.abs.gov.au/AUSSTATS/abs@.nsf/ 
allprimarymainfeatures/28B78F2A7DE96540CA2573F500152241) 


Time Use, 2006 (/statistics/microdata-tablebuilder/available-microdata-tablebuilder/time-use) 


Safe researcher training 


Registering your interest to attend DataLab training, and training resources 


Released 19/11/2021 
What is safe researcher training 


DataLab safe researcher training must be undertaken before you can use the DataLab or be approved on a project: 


e training enables new users to become approved DataLab researchers or discussants 
e available as face-to-face training via ABS offices, in most capital cities 


e also available as virtual training 
Training covers: 


e your shared responsibilities as a DataLab user 
¢ meeting your legislative requirements 


¢ appropriate output for ABS clearance and data release 


The training does not include: 


e using the system 


e using the data 


statistical capability training 


e code or analytical language training 


Safe researcher training and DataLab access are only available to researchers located in Australia in Australian organisations. 


International researchers and organisations will be considered on a case by case basis. 
DataLab training current wait time is approximately 4 weeks 
How to register and enrol in a session 


Register for DataLab safe researcher training via the myDATA portal (https://mydataportal.abs.gov.au/) . The myDATA portal 


will be your one-stop shop for all aspects of DataLab training, onboarding and project management. 


Once you have created your myDATA portal (https://mydataportal.abs.gov.au/) user account, click on the ‘My onboarding' tile. 


You will find an ‘Enrol in training’ button. Click on the magnifying glass to select the training session that best suits you and 


click ‘Select’. Should there not be a suitable session, click on the 'No session suitable’ and we will contact you directly. 


Detailed registration steps are listed in the User Guide here (/statistics/microdata-tablebuilder/datalab#mydata-beta-portal- 


user-guides) . 


Email data.services@abs.gov.au (mailto:data.services@abs.gov.au) if you have issues with registering in the portal. 


Refresher training 


The successful and safe operation of the ABS DataLab relies upon researchers understanding their responsibilities and 


obligations when accessing the ABS DataLab. 


All researchers seeking access to the ABS DataLab, including discussants, must complete the DataLab Safe Researcher 


training and satisfactorily complete a quiz before they will be granted access to the DataLab. 
To retain access to the DataLab researchers must: 


e undertake refresher training every two years or as directed by the ABS Researcher Onboarding and System Support 


e resubmit relevant Declarations and Undertaking covering your responsibilities and obligations every two years or as 
required and as directed by the ABS Researcher Onboarding and System Support 


If you think you might be due for refresher training please email data.services@abs.gov.au (mailto:data.services@abs.gov.au) 


Changing organisations does not invalidate a researcher's training status and the usual refresher training requirements apply. 


Refresher training policy: 


Researchers need to undertake refresher training because: 


e key operations, such as output checking procedures and rules, will change over time 

e reinforcing key elements on a regular basis reduces the likelihood that researchers forget them 

e people can become complacent about complying with appropriate behaviours in the DataLab 

e training reinforces the need to constantly refresh ones skills and knowledge about implementing safe researcher practices 


e this ensures researchers remain aware of their responsibilities and obligations when using the DataLab 
The refresher training policy requires: 
e all active users and discussants to complete the Safe Researcher DataLab refresher training every two years, or sooner if 


instructed to by the ABS 


e resubmit relevant Declarations and Undertaking covering on responsibilities and obligations every two years, or sooner if 
instructed to by the ABS 


¢ complete the training in the time-frame specified by the ABS to ensure access is not suspended. 


Safe researcher training resources 

The slides linked below are presented during the DataLab Safe Researcher Training. 
Part 1- Working together to enable microdata access 

Part 2 - Maintaining data confidentiality 


Part 3 - Statistical disclosure control 


= DataLab safe researcher training Parts 1 and 2 (PDF) (/system/files/documents/7e88021292af4b7a8e751d58697fbebd/ 
DataLab% 20Safe% 20Researcher% 20Virtual% 20 Training % 20Pt1% 20and%20Pt2_Final%202024.pdf) 


= DataLab safe researcher training Part 3 (PDF) (/system/files/documents/becicc42a3e20dd01d9748b621f8b8b7/ 
DataLab% 20Safe% 20Researcher% 20Virtual % 20 Training_Pt3_Safe% 200utputs_JAN %202024.pdf) 


You should also read Responsible use of ABS microdata user guide (/statistics/microdata-tablebuilder/responsible-use-abs- 


microdata) and Using DataLab Responsibly (/statistics/microdata-tablebuilder/datalab/using-datalab-responsibly) to 


understand your responsibilities as a safe researcher. 
Conditions of use 


DataLab and myDATA conditions of use 


Released 20/07/2022 
DataLab conditions of use 


By accessing and using DataLab, you agree to abide by the administering organisation's relevant requirements and 
obligations, including the conditions outlined below. If you cannot abide by these conditions, your use of the system is to 
cease immediately. 


By using DataLab, | agree: 


1. To adhere to all access, usage, security and other procedural guidelines within DataLab as directed by the ABS. Including 
those provided in the Undertaking by the Responsible Officer of an Organisation, Undertaking by an individual, Declaration 
of Compliance, and other directions provided to me. 


2. To take all necessary measures to protect the security of DataLab and the data held within, by safeguarding my access 
credentials and promptly notifying the ABS of any security incidents or procedural failures. 


3. To adhere, where applicable, to ABS system constraints. 


4. To the possibility that the ABS may discuss my registration and access with the administering organisation, who have the 
authority to remove my access. 


5. To comply with the ABS conditions of sale 
6. To use and operate DataLab in compliance with the relevant operating manuals and documentation. 


7. To not remove or attempt to remove content from DataLab by any means, including extracting or copying material by 
screen capture, handwritten notes, or transcription, without obtaining written approval from the ABS. 


8. To uphold the integrity of ABS intellectual property by not removing, obscuring, or altering any ABS attributions, including 
logos, legal notices, or other labels visible in DataLab. 


9. To not attempt to load code, software or applications without seeking the appropriate authorisation from the ABS. 


10. To cooperate with any audit or investigation initiated by the ABS or administering organisation that pertains to any matter 
concerning the DataLab. 


11. Delete or destroy data when requested to do so by the ABS. 
| acknowledge that: 


1. My use of DataLab may be audited by the ABS. 
2. DataLab is authorised for use only within Australia unless prior written authorisation has been provided by the ABS. 


3. A breach of these conditions may result in sanctions which may include, but are not limited to, the ABS revoking my access 
to DataLab permanently or for a set period. 


4. The ABS will not provide guidance on how to conduct data analysis, modelling or how to utilise the statistical tools 
available. 


5. Features and functionality of DataLab may undergo necessary changes or upgrades without user consultation. 
6. The ABS does not guarantee, or accept any legal liability arising from, or connected to the use of material connected 
within, or derived from DataLab. 


Expected behaviours: 


1. Comply with the protocols and instructions of the ABS. 


2. Access only the data | have been approved to access. and notify the ABS if you think you have access to data you 
shouldn't 


Not attempt to avoid, override, or bypass the system or procedures. 


3. 

4. Maintain data confidentiality when submitting outputs for review. 

5. Request output clearance through the ABS DataLab Clearance procedure in all instances. 
6. 


Notify the ABS of any suspected activities that may impact the security of DataLab. 


Remote access: 
Remote access within Australia is permitted under the following conditions: 


1. DataLab must only be accessed from a work or private location. 
2. A secure internet connection must be used. 
3. Overseas access to DataLab is not permitted unless approved by the ABS. 


4. Do not use any type of internal messaging system, do not screen sharing and do not transcribe any data from the DataLab 
prior to output clearance 


myDATA conditions of use 


The following conditions are applicable to all users registered in My Data Approvals to Access (myDATA) for access to 


DataLab projects. 
By registering in myDATA, | agree: 


1. To provide true and correct information about my identity and contact details when registering, and if these details change, 
to provide the updated details to the ABS. | understand if | leave my organisation new approvals need to be sought for 
continued access to data or systems. 


2. The ABS may discuss my registration and access with my organisation's Contact Officer and Project lead, who have the 
authority to remove my access. 


3. To keep my log in credentials for ABS systems secure and not share my log in credentials with any other person or 
organisation. 


4. ABS can share my project information, such as contact details, project name, project lead and organisation and dataset 
access with other organisations and users. This information will only be shared at the discretion of the ABS for the 
purposes of administering access to data, such as seeking approvals on your behalf with the data custodians responsible 
for the data, system logging and disclosing user details to other users for the purpose of enabling collaboration. 


5. ABS can share with other organisations confidentialised information about my organisation's system and data usage, for 
the purposes of usage reporting, auditing, feedback or performance. Any personal information collected will be held while 
there is a business need and kept in accordance with the Privacy Act 1988. See also, ABS privacy policy (/about/ 
legislation-and-policy/privacy/privacy-abs) and DataLab privacy notice. (/about/legislation-and-policy/privacy/datalab- 
privacy-notice) 


6. ABS may contact me to provide me with information about data, systems or products, such as upcoming releases, system 
changes or to seek my feedback. 


7. To comply with the ABS conditions of sale. 
| acknowledge that: 


1. My use of myDATA and ABS systems may be audited. 


2. The ABS may partially or fully remove, suspend or deactivate my access to ABS systems, data, files or tables. This may be 
for ABS operational reasons, such as implementing changes to data or systems, or for a breach of ABS directions and 


system constraints. 


3. A breach of these conditions of use may result in sanctions which may include, but are not limited to, ABS removing 
access to these systems for me and/or my organisation permanently or for a set period of time. 


4. Removal of access does not entitle a user or organisation to a refund of any subscription charges and the ABS is not liable 
for any damages this removal of access may have for a user or organisation. 


5. While the ABS has taken great care to ensure that the information provided within ABS systems is as correct and accurate 
as possible, the ABS does not guarantee, or accept any legal liability arising from, or connected to, the use of any material 
contained within, or derived from these systems. See ABS disclaimer (/website-privacy-copyright-and- 
disclaimer#disclaimer) for further information. 


Privacy 


The ABS privacy policy (/about/legislation-and-policy/privacy/privacy-abs) and DataLab user privacy notice (/about/ 


legislation-and-policy/privacy/datalab-privacy-notice) outline how the ABS handles any personal information that you provide 


to us. 


The ABS Privacy Policy for Managing and Operating Our Business (/about/legislation-and-policy/privacy/privacy-abs/abs- 


privacy-policy-managing-and-operating-our-business) outlines how we handle personal information that is collected for 


managing and operating within the ABS. 
Using DataLab responsibly 


Roles and expected behaviours for being a safe researcher in the ABS DataLab 


Released 4/11/2021 
Roles and expected behaviours 


ABS 


* encourages, promotes and supports the use of data for research and/or statistical purposes 


provides training on guidelines and compliance requirements for safe researchers and safe use of data 
e provides a secure environment for flexible and wide-ranging microdata access to meet researchers' needs 


e provides a range of statistical packages and updates 


provides adequate metadata 


e manages the authorisation, provision and removal of access to microdata 


provides researchers with the principles and rules for safe outputs 


e provides a cultural review of Aboriginal and Torres Strait Islander data projects through its Centre of Aboriginal and Torres 
Strait Islander Statistics 


checks outputs and provides advice on how to make outputs non-disclosive 


e responds to questions relating to the data, processes and systems, in a timely manner 


respects researchers’ academic independence 


¢ monitors and audits DataLab use to ensure compliance with procedures and legislative requirements 


Lead researchers 


¢ submit your research proposal to the ABS by following the steps in the DataLab User Guide (/statistics/microdata- 
tablebuilder/datalab) 


provide an updated project proposal (/statistics/microdata-tablebuilder/datalab#:~:text=Project% 20proposal%20templates 
) to reflect changes to the team, scope, project time frames and/or data requirements - use the 'Document history' section 
on page 2 of the project proposal to advise us of any changes 


support your research team to adhere to DataLab safe researcher practices and behaviours and building a culture of best 
practice within your team 


provide feedback on the outcomes of your project and experience with the ABS microdata and DataLab upon project 
closure 


provide ABS with two weeks notice before release and then provide a link to any published research stemming from the 
project's findings 


advise the DataLab team immediately of any suspected incidents in the DataLab, including both data security or 


procedural failures 
e support the ABS in communicating key messages with your research team 


e adhere to any relevant requirements of analysts 
Approved project team researchers/analysts 


As an approved project team analyst, you have access to the DataLab and may discuss uncleared data with other approved 


analysts or discussants on your project team. You must: 


¢ meet all on-boarding requirements, including: 
* completing the safe researcher (/statistics/microdata-tablebuilder/datalab/safe-researcher-training) DataLab training 


¢ confirming you are willing to have your name, organisation, microdata you have access to, projects, and links to 
resultant papers published from the research on a register on the ABS website (unless otherwise agreed in advance) 


confirming you belong to an organisation that has a Responsible Officer undertaking (/statistics/microdata-tablebuilder/ 


responsible-use-abs-microdata/undertakings-and-declarations#responsible-officer-undertaking) in place with the ABS 


signing and agreeing to the conditions in the individual undertaking (/statistics/microdata-tablebuilder/responsible-use- 


abs-microdata/undertakings-and-declarations#individual-undertaking) and other associated paperwork (including the 
Declaration of Compliance (/statistics/microdata-tablebuilder/responsible-use-abs-microdata/undertakings-and- 
declarations#datalab-forms) ) 


confirming in writing that you are not currently restricted from accessing government data, or any other data due to 
misuse of data or a breach of data policy/procedures 


declaring you have at least three years’ quantitative research experience or university study with a significant 
component working with quantitative data, or if this is not possible comply with the pre-requisite skills and/or 
experience expected of approved researchers (/statistics/microdata-tablebuilder/datalab/using-datalab- 
responsibly#requirements-to-become-an-approved-researcher) 


having experience with at least one of the statistical analytical languages (/statistics/microdata-tablebuilder/datalab/ 
using-your-workspace#available-software) available in the DataLab 


comply with ABS protocols and instructions for access and use of microdata in the DataLab 


access only the microdata you have been approved to access - if you can access data that you believe you should not be 
able to, contact the DataLab team immediately 


inform the ABS if you leave the project team or if you leave your organisation 


only access the DataLab from a private location with a secure internet connection, not from public networks or spaces 


protect your work area and screen from oversight by others, including unauthorised colleagues, family, children and pet 
cams 


not screen share your DataLab session or content, even when meeting only with approved researchers on your project 
team 


keep passwords for the DataLab secure 


not share DataLab log in credentials 


not attempt to identify individuals or organisations within data held in the DataLab 


not attempt to match DataLab unit record data with any other list, database or repository of persons or organisations 


not attempt to avoid, override or otherwise circumvent the system or procedures 


not transcribe or copy anything from the DataLab prior to output clearance (this includes screen sharing or any written or 
photographic form) 


not transcribe or copy anything from the DataLab prior to output clearance to share it with any other researcher (approved 
or not) or with ABS personnel or the Researcher Onboarding and System Support team 


only use the shared project space within the DataLab to share uncleared work with approved project researchers or to 
communicate with ABS DataLab support areas about uncleared data 


do not send outputs to be cleared to the DataLab team - you must request output clearance (/statistics/microdata- 
tablebuilder/datalab/input-and-output-clearance#request-output-clearance) 


do not attempt to link two microdata files within the DataLab at the unit record level based on matching characteristics, 
except where linking keys have been provided and the files are designed to be linked 


not deliberately attempt to identify individual or organisational respondents or mishandle a spontaneous recognition event 


be aware that data confidentiality is your responsibility when submitting outputs for review - see Confidentiality in ABS 


microdata (/statistics/research/confidentiality-abs-microdata) and output guidelines (/statistics/microdata-tablebuilder/ 
datalab/input-and-output-clearance) for more information 


¢ report any security incidents or procedural failures to DataLab team immediately via data.services@abs.gov.au 
(mailto:data.services@abs.gov.au) and cc the lead researcher 


Approved project team researchers/discussants 


As an approved project team discussant, you do not have access to the DataLab but may discuss uncleared data with other 


approved analysts or discussants on your project team. You must: 


¢ meet all on-boarding requirements, including completion of the safe researcher (/statistics/microdata-tablebuilder/datalab/ 
safe-researcher-training) DataLab training and signing of all relevant undertakings 


e seek approval from the ABS, via the project lead, if you wish to become a DataLab analyst 


e adhere to any relevant requirements of project team researchers/analysts 
Guiding principles 
External communication 
We encourage you to communicate as much as possible within the DataLab environment. 


If you need to communicate via other means, consider what is to be communicated and how the communication will take 


place to ensure that you do not inadvertently remove uncleared data from the DataLab. 


Managing communication 


e You can use notes within the DataLab to leave messages for other approved project team members. Let them know that 
you have left a note and would like them to view it. 


e You can talk to your supervisor/s about the data, if they are approved researchers or discussants on the project, but 
consider the environment and who is around. 


e Phone calls and video conferencing may be used for discussions but never share your screen. 


e Do not transmit any uncleared DataLab output in an email, including with ABS personnel or the Researcher Onboarding and 
System Support team. Instead, let your approved project team colleague or the ABS know and ask them to view the issue 
within the DataLab. Similarly your approved colleagues or the ABS need to leave their responding information within the 
DataLab and let you know that there is information for you within the project in the DataLab. 


Remote access 
ABS trusts and supports approved researchers who remotely access the DataLab. 
Remote access is permitted under the following conditions: 


e It must be used in a work or private location. 


e The screen must be protected from oversight by any other person. This includes password-protecting you screen, should 
you move away from you computer. 


e A secure internet connection must be used: 
e A secure internet connection means any Wi-Fi that is password protected (e.g. work, home, your hotel room, 
hotspotting from your phone) 


e Anon-secure internet connection means an open or public connection like a restaurant/cafe, airport, public transport, 
hotel lobby or shopping mall 
e Overseas access to DataLab is not allowed under any circumstances. 


e Working in the DataLab from home is supported by the ABS but you are responsible for checking and complying with your 
organisation's requirements for working from home. 


e Do not use any type of internal messaging system which may have external server connections. 


e The DataLab screens are to be kept secure at all times whether you are working within your organisation or from home. 


Further information is available in the Responsible use of ABS microdata user guide (/statistics/microdata-tablebuilder/ 


responsible-use-abs-microdata) . 


Requirements to become an approved researcher 


Pre-requisite skills and/or research experience required of approved researchers 


To be an approved DataLab researcher, you must have the analytical research experience to be able to carry out quantitative 
data research or analysis in the DataLab This includes the ability to use at least one of the statistical analytical languages 
supported in the DataLab. This may have been acquired through working on research, analytical or statistical projects. For 
example, a person who was employed for three years in a relevant field, such as a university researcher, research assistant or 
a government or non-government employee working in research or statistics. If they had worked for around half of their time 
on quantitative research projects, then they would have spent a significant component of their time working with quantitative 
data. 


You may also have qualifications (either an undergraduate or higher degree) with a significant proportion of mathematics or 


statistics. A significant proportion of the degree should cover research method components and analytical fields, including: 


¢ qualitative data collection and research design, interviewing skills, conducting focus groups and ethnographic methods 
¢ quantitative data collection and research design, questionnaire design, sampling and weighting 


e hypothesis testing and evaluation 


undertaking systematic reviews 
e data analysis, including data linkage, imputation and presentation of results 


¢ application of ethics to research 


Other relevant undergraduate degrees may include psychology, demography, social policy, sociology, political science, 
geography, economics, and social statistics. If you have postgraduate qualifications, you may combine multiple degrees to 


ensure you meet this requirement. This is a cumulative requirement. 


If you do not meet the above criteria but still want to access the DataLab, you may request a referral by an authorised 


researcher who is on the same research team as you. The referring researcher must meet all of the following requirements: 
e have at least three years of either quantitative research or analysis experience or university study with a significant 
component working with quantitative data 
e be working on the same project within the DataLab as the less experienced researcher 


e agree to directly supervise and take responsibility for the work of the less experienced researcher 


have the agreement of a Senior Executive from the less experienced researcher's organisation for this referral 


Download the undertaking, declaration and referral forms (/statistics/microdata-tablebuilder/responsible-use-abs-microdata/ 


undertakings-and-declarations) . 


The ABS does not provide support to researchers relating to statistical analytical languages or coding issues. 


Publishing and citing data 
Referencing DataLab data in publications 
Preparing outputs to be published 


e Publishing refers to making information available to the public by any means. 


e The ABS encourages researchers to share their research findings (which have been cleared for confidentiality by the ABS) 
and make the results publicly available. 


e If the ABS have cleared and sent you your outputs from the DataLab it means they have passed statistical disclosure 
checks and are cleared to be released. 


When do | need to inform the ABS | am publishing? 


e Any publication, report and presentation that references BLADE or PLIDA data needs to be provided to the ABS a minimum 
of 2 weeks prior to wider release. This is a requirement of our Data Custodians. This process does not seek approval from 
custodians, but rather is in place to give custodians visibility of project outputs, provide comments and brief Ministers, as 
required. Analysts are sent any comments or feedback provided by custodians on their publications. 


e Project teams can use outputs referencing BLADE or PLIDA data as part of preliminary analysis and to collaborate with 
others. This does not require the 2 weeks notice for the ABS. At this stage your outputs are considered as draft analysis 
and are not yet published and not for further circulation. When you are circulating this draft analysis, it should be clearly 


stated the analysis is draft and not for further distribution. 


e When your analysis is ready to publish that's when the 2 weeks clearance applies. 
How do | cite my work? 


Information and research using ABS data must be acknowledged. 
When citing the ABS DataLab the preferred citation structure is as follows: 


1. Source of Data: e.g. Person-Level Integrated Data Asset (PLIDA). 

2. Date/reference period of data used 

3. PLIDA product: e.g. PLIDA Modular Product 

4. Pathway of access: e.g. ABS DataLab 

5. Statement: “Findings based on use of PLIDA data. 

6. Include an explanation of any processes or transformations which have been applied to that data 


7. \f you are using data from ATO, DSS or Home Affairs you must also include the following disclaimer: 


"The results of these studies are based, in part, on data supplied to the ABS under the Taxation Administration Act 1953, A 
New Tax System (Australian Business Number) Act 1999, Australian Border Force Act 2015, Social Security 
(Administration) Act 1999, A New Tax System (Family Assistance) (Administration) Act 1999, Paid Parental Leave Act 2010 
and/or the Student Assistance Act 1973. Such data may only used for the purpose of administering the Census and 
Statistics Act 1905 or performance of functions of the ABS as set out in section 6 of the Australian Bureau of Statistics Act 
1975. No individual information collected under the Census and Statistics Act 1905 is provided back to custodians for 
administrative or regulatory purposes. Any discussion of data limitations or weaknesses is in the context of using the data 
for statistical purposes and is not related to the ability of the data to support the Australian Taxation Office, Australian 


Business Register, Department of Social Services and/or Department of Home Affairs’ core operational requirements. 


Legislative requirements to ensure privacy and secrecy of these data have been followed. For access to PLIDA and/or 
BLADE data under Section 16A of the ABS Act 1975 or enabled by section 15 of the Census and Statistics (Information 
Release and Access) Determination 2018, source data are de-identified and so data about specific individuals has not been 
viewed in conducting this analysis. In accordance with the Census and Statistics Act 1905, results have been treated 


where necessary to ensure that they are not likely to enable identification of a particular person or organisation.” 
Please refer to these examples: 
Example 1 


Person Level Integrated Data Asset (PLIDA), 2021, Census of Population and Housing, ABS DataLab. Findings based on use of 
PLIDA data. 


Example 2 
Australian Bureau of Statistics (2020) Microdata: Personal Income of Migrants, Australia, accessed 15 December 2020 


A citation of your work will be added to the short online description of your project once your work is published, See also How 


to cite ABS sources 


Failing to comply with DataLab conditions of use 


As an approved researcher, you have signed appropriate documentation agreeing to comply with data access provisions 


under relevant legislation, whenever you access detailed microdata in the DataLab. 


If you suspect that you or others in your team may have failed to comply with a microdata undertaking, immediately cease the 


behaviour, notify the lead researcher and email data.services@abs.gov.au (mailto:data.services@abs.gov.au?? 


&subject=DataLab request for offline local disk space&Body=Dear ABS%OD%*OA%OD%OAI would like to request access to 


local disk space in my DataLab account so that | can run jobs on offline VMs.) as soon as possible. 


For further information, see Consequences of failing to comply with a microdata undertaking (/statistics/microdata- 


tablebuilder/responsible-use-abs-microdata/undertakings-and-declarations#consequences-of-non-compliance-with-an- 


undertaking) in the Responsible use of ABS microdata user guide. 
Input and output clearance 


Requesting input, output and transfer clearance. Applying the output rules to your analysis. 
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DataLab clearance instructions and templates 


Request output clearance 


DataLab outputs must be approved and cleared by the ABS before being shared. Output requests generally take 1-2 weeks to 
be completed. Large, complex, or insufficiently described files will take longer to review. Please apply data minimisation 
principles and only request what you need. You must not copy or remove anything (for example data, code, notes) out of the 


DataLab yourself. Please do not include any counts or data from DataLab in your emails with the ABS. 
To request output clearance: 


1. Format the data with clear headings and labels (ODS or ODT format is preferred). 
2. Apply the appropriate output rules and prepare evidence in a separate file. 
3. Move the relevant files, including supporting evidence, to a new sub-folder in the output (O:) drive. 


4. Click the button below to generate an email and then complete the details and send. 


& Request output clearance (mailto:datalab.clearance@abs.gov.au?Subject=Request DataLab output clearance&Body=1. 
Virtual machine (VM): %0D%0A2. Project name: %0D%0A3. (Optional) If urgent, date required and justification: %OD%0A4. 
Output drive sub-folder path: O:/%0D%0A5. Names of files requiring clearance: %0D%OA6. (If relevant) Names of files with 
supporting evidence: %0D%0A7. Data products used to produce output (e.g. blade1617_core): %OD%0A%0D%0A8. 
Relationship of output to project objectives: %0D%0AQ. (If relevant) Relationship to previous requests: %0D%0A%0D%0A10. 


For each table / model / graph:%0D%0A%O09Description of output (e.g. weighted income by age, logistic regression model to 


predict health service usage) %0D%0A%09People / businesses in scope including reference period (e.g. mining businesses 


operating in 2019)%0D%0A%09Definitions of each original and self-constructed variable in output (e.g. count: unweighted 


count of people) %0D%0A%09O0utput rules applied (e.g. Rule of 10 on unweighted counts, dominance, degrees of 


freedom)%0D%0A%0D%0A** Reminder: Do not include counts or data in emails **) 


If the link does not generate an email, please use the following template in a new email. Do not reply to, forward or copy an 


existing email chain for a new request as this will not be received. 


To: datalab.clearance@abs.gov.au 


Subject: Request DataLab output clearance 


1. Virtual machine (VM): 

2. Project name: 

3. (Optional) If urgent, date required and justification: 
4. Output drive sub-folder path: O:/ 

5. Names of files requiring clearance: 

6. (If relevant) Names of files with supporting evidence: 
7 


. Data products used to produce output (e.g. blade1617_core): 


ioe} 


. Relationship of output to project objectives: 


9. (If relevant) Relationship to previous requests: 


LO. For each table / model / graph: 


Description of output (e.g. weighted income by age, logistic regression model to predict health service usage) 


e People / businesses in scope including reference period (e.g. mining businesses operating in 2019) 


Definitions of each original and self-constructed variable in output (e.g. count: unweighted count of people, empstat: 
employment status) 


Output rules applied (e.g. Rule of 10 on unweighted counts, dominance, degrees of freedom) 


** Reminder: Do not include counts or data in emails ** 


Request input clearance 


This request is only for loading aggregate data, concordances, supporting material or statistical code to DataLab projects. To 


add microdata to your project, please submit an existing DataLab project query (/statistics/microdata-tablebuilder/datalab/ 


contact-us/#existing-datalab-project-query) . To request new software or a software package, please use this template (/ 


statistics/microdata-tablebuilder/datalab/contact-us#request-new-software-or-software-packages) . 


The following will not be loaded to the DataLab. 


e Names of people or businesses 
e Addresses or longitudes and latitudes for specific locations 


e Free text fields 
To request input clearance: 


1. Click the button below to generate an email and complete the details. 


2. Attach any files for input and send. 


& Request input clearance (mailto:datalab.clearance@abs.gov.au?Subject=Request DataLab input file load&Body=1. Virtual 
machine (VM): %0D%0A2. Project name: %0D%0A3. (Optional) If urgent, date required and justification: %OD%0A4. File type 
(e.g. code, aggregate data, correspondence file): %~OD%0A%0D%OAS. If publicly available: %OD%0A%09Source URL: 
%0D%0A%O09Terms of use (e.g. Creative Commons Attribution 4.0): %OD%0A%0D%OABG. If not publicly available: 
%0D%09Name of owner/author/custodian: %OD%0A%09Attach consent to use file in DataLab.%O0D%0A%0D%0A7. 
Description of each file: %OD%0A8. How each file will be used: %0D%0AQ. For data tables - description of each variable:) 


If the link does not generate an email, please use the following template in a new email. Do not reply to, forward or copy an 


existing email chain for a new request as this will not be received. 


To: datalab.clearance@abs.gov.au 
Subject: Request DataLab input file load 


1. Virtual machine (VM): 

2. Project name: 

3. (Optional) If urgent, date required and justification: 

4. File type (e.g. code, aggregate data, correspondence file): 
5. If publicly available: 


Source URL: 
Terms of use (e.g. Creative Commons Attribution 4.0): 


6. If not publicly available: 
Name of owner/author/custodian: 
Attach consent to use file in DataLab. 
7. Description of each file: 
8. How the file will be used: 


9. For data tables - description of each variable: 
Request transfer between projects 


This request is to move code and other files that do not contain data between DataLab projects. Please ensure there are no 
counts or IDs anywhere, including in logs or comments. If you wish to move files containing data, please submit an output 


request ensuring all output rules are met and note that you want it transferred to another project. 
To request transfer clearance: 


1. Check files do not contain any data. 
2. Move the relevant files to a new sub-folder in the output (O:) drive. 


3. Click the button below to generate an email and then complete the details and send. 


& Request transfer between projects (mailto:datalab.clearance@abs.gov.au?subject=Request DataLab file transfer&Body=1. 
Transfer from virtual machine (VM): %0D%OA2. Transfer to VM: %0D%0A3. (Optional) if urgent, date required and 
justification: %OD%0A4. Output drive sub-folder path: O:/%O0D%0A5. Names of files requiring transfer: %0D%O0A6. Reason 
for moving files: %OD%0A%0D%OA** Reminder: Do not include counts or data in emails **) 


If the link does not generate an email, please use the following template in a new email. Do not reply to, forward or copy an 


existing email chain for a new request as this will not be received. 


To: datalab.clearance@abs.gov.au 
Subject: Request DataLab file transfer 


. Transfer from virtual machine (VM): 
. Transfer to VM: 


. (Optional) If urgent, date required and justification: 


1 
2 
3 
4. Output drive sub-folder path: O:/ 
5. Names of files requiring transfer: 
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. Reason for moving files: 
** Reminder: Do not include counts or data in emails ** 
Output rules quick reference table 


The most common types of analysis are listed below along with the applicable rules for output. Other output types will be 


assessed based on similar principles. 


Output type Applicable rules 
Frequency tables (counts, Rule of 10 (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#rule-of-10) 
percentages) Group disclosure (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#group-disclosure) 


Rule of 10 (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#rule-of-10) 

Group disclosure (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#group-disclosure) 
Dominance (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#dominance) 

Minimum contributors for quantiles (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#minimum- 
contributors-for-quantiles) 
Minimum contributors for quantiles (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#minimum- 
contributors-for-quantiles) 

Degrees of freedom (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#degrees-of-freedom) 
Model-specific rules (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#model-specific-rules) 


Magnitude statistics (means, 
sums, ratios) 


Quantiles (percentiles, medians) 


Minimums, maximums, ranges 


Models including regressions 


Charts (graphs, plots 


: Chart clearance (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#chart-clearance) 
and histograms) 


Microdata Not appropriate for output 
Synthetic microdata Not appropriate for output 
Rule of 10 


The rule of 10 refers to the minimum number of contributors required for each cell or statistic. The underlying (unweighted) 


count of observations must meet this threshold, and evidence must be provided. 
If multiple tables are produced, differences of less than ten should not be able to be calculated through combining the tables. 


The rule of 10 applies to most outputs including counts, percentages (both numerator and denominator), means, sums, ratios, 
and other statistics. 


Options for making output safe include suppression of small counts, aggregation of categories or perturbation. If a cell is 
suppressed but it can be derived or estimated from other outputs, one or more additional values should be suppressed to 


protect the values of the the primary suppressed cell from being worked out. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Dominance 


The dominance rule is designed to prevent the re-identification of units that contribute a large percentage of a cell's total 


value, which could in turn reveal information about individuals, households or businesses. 


DataLab has a (1,50) and a (2,67) rule. This means that for any cell, the largest contributor cannot account for more than 50% 


of the total value and the largest two contributors cannot account for more than 67% of the total value. 


Where a variable can take both positive and negative values, the negative values should be replaced with absolute values 
before determining the largest contributors and the total. The largest absolute value is then divided by the sum of absolute 
values to determine if the (1,50) rule is met, and the sum of the two largest absolute values are divided by the sum of absolute 


values to check the (2,67) rule. 


Similar to the rule of 10 (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#rule-of-10) , in the case of the 


dominance rule failing and if a cell is suppressed but it can be derived or estimated from other outputs, one or more additional 


values should be suppressed to protect the values of the primary suppressed cell from being worked out. 


Dominance must be checked if any mean, total or similar statistic is calculated for continuous or magnitude variables. It does 


not apply to counts. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Group disclosure 


Group (or attribute) disclosure occurs when all or nearly all units that have one feature also have some other feature. This 
means that even when the individual units may appear protected based on other rules, a previously unknown attribute of a 
unit may be disclosed based on the attributes of the group. Group disclosure risk should be assessed when any cell contains 


more than 90% of total number of units in the row or column. 


This rule applies to frequency tables. Whether group disclosure requires treatment depends on the sensitivity and nature of 


the output. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Minimum contributors for quantiles 


Quantiles and other relative ranks must be based on a minimum number of contributors depending on the precision. 
Underlying unweighted counts should be provided when reporting quantiles in the outputs. For information on required 


contributors for quantiles, see the table below: 


Quantile Minimum contributors 
Medians (0.50 ) 10 
Quartiles ( 0.25, 0.5, 0.75 ) 20 
Quintiles ( 0.2, 0.4, 0.6, 0.8 ) 25 
Deciles ( 0.1, 0.2, 0.3 ... 0.9) 50 
Vigintiles ( 0.05, 0.1, 0.15 ... 0.95 ) 100 
Percentiles ( 0.01, 0.02 ... 0.99 ) 500 


Minimums and maximums are generally unsafe to output. The following percentiles are safe options if the minimum 
contributors rule is satisfied: 


e Ist and 99th percentiles 
e 5th and 95th percentiles 
e 10th and 90th percentiles 


See Data downloads (#data-downloads) for examples and options for treatment. 


Degrees of freedom 


Models and regressions are generally safe to output. However, overfitted models can pose a disclosure risk. All models and 


regressions must have a minimum of 10 degrees of freedom and evidence that this has been met should be provided. 


The degrees of freedom are calculated by subtracting the number of parameters and other model restrictions from the total 


number of observations that contribute to the model. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Model-specific rules 
There are additional rules for specific model types. 


For ordinary least squares regressions, the R-squared should be lower than 0.9. If the R-squared is higher than this, the 
constant may need to be suppressed to prevent predictions. This requirement does not apply to other models such as fixed 


effects or two-stage regressions. 


Additionally, for ordinary least squares regressions with a continuous dependent variable and only categorical independent 
variables, the regression will approximate the tabular means. The addition of a continuous independent variable, or 


suppression of the intercept reduces the disclosure risk. Otherwise, apply the rule of 10 (/statistics/microdata-tablebuilder/ 


datalab/input-and-output-clearance#rule-of-10) and dominance (/statistics/microdata-tablebuilder/datalab/input-and-output- 


clearance#dominance) rules. 


For survival curves, each step change in the survival curve should represent at least 10 data subjects. 
Correlation coefficients should be calculated based on a minimum of 10 contributors. 
Gini coefficients are usually safe to output, and must be based on a minimum of 10 contributors. 


For classification and regression trees, any underlying unweighted counts must meet the rule of 10 (/statistics/microdata- 


tablebuilder/datalab/input-and-output-clearance#rule-of-10) . 


For other models, please provide evidence that no estimates or parameters are derived from fewer than 10 underlying 


contributors and explain why the output is non-disclosive. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Chart clearance 


All graphs, plots and other charts are subject to the output rules that apply to the underlying output type. The data used in the 


chart must be provided, accompanied by any relevant supporting evidence that it meets output rules. 
Charts that plot characteristics of individual units or groups of fewer than 10 units will not be cleared. 


See Data downloads (#data-downloads) for examples and options for treatment. 


Data downloads 


DataLab output clearance examples (not real data) 


Data files 
[=] Download xlsx [128.71 KB] 


Logging into the portal and workspace 


Logging in, launching your VM, first time use/new phone steps, resetting your password 
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There are two steps when logging into DataLab, which have been streamlined as of August 2023: 


1. Log into the DataLab portal (#log-into-the-datalab-portal) where you can access information and settings related to your 
profile, project and start your virtual machine (VM) 


2. Launch the VM (#launch-the-vm) for your project where you and your project team members view data, run analysis and 
prepare reports or data outputs for clearance 


Log into the DataLab portal 


Enter your account details into the DataLab (https://new.datalab.abs.gov.au/) log in page. 


If you are logging in for the first time, for system security you will need to authenticate your log in using the Microsoft 


Authenticator app on your mobile phone. To set this up, see First time use/new phone steps (#first-time-use-new-phone- 


steps) . 


For returning users, click on your account (firstname.lasthname@mydata.abs.gov.au) or use another account and enter your 


account name. All DataLab accounts use the @mydata.abs.gov.au domain format. Enter your password and Sign in. 
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Australian 
Bureau of 
Statistics 


Pick an account © example.user@mydata.abs.gov.au 


Enter password 


Password 


[3] example.user@mydata.abs.gov.au 


+ Use another account Forgotten my password 


By logging in you agree to these conditions: 
Important Notice 


If you are not authorised to access this system, exit immediately. Unauthorised users may be subject to criminal and civil 


penalties. 


This is an Australian Government computer system. Part 10.7 of the Criminal Code Act 1995 outlines the penalties that may 
apply for unlawful use of Government systems including unauthorised access, modification or impairment of computer 
systems, data or electronic communications. The Act provides penalties of up to 10 years imprisonment for such offences. By 
proceeding, you are representing yourself as an authorised user and acknowledge you have read and agree to comply with 


the Responsible Use of ABS Microdata User Guide (/statistics/microdata-tablebuilder/responsible-use-abs-microdata) . Your 


activity will be logged, monitored and investigated should any misuse be suspected. 


Sanctions ranging from a reprimand to revocation of access or termination of employment may be imposed if misuse is 


determined. 


Once you have entered your credentials and hit ‘Sign in’, a notification from the Microsoft Authenticator app is sent to your 
phone and asks you to perform a “number match”. Enter the numbers shown on your browser screen into the authenticator 


app on your phone to proceed. 
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eRe HSCEI poy Enter the number shown to sign in. 
Approve sign-in request Enter number here 
3) Open your Authenticator app, and G7) 
~ enter the number shown to sign in. 
ves 


No numbers in your app? Make sure to 
upgrade to the latest version. 


NO, IT'S NOT ME 


| can't use my Microsoft Authenticator app right 


now | CAN'T SEE THE NUMBER 


More information 


If you don't approve within the time limit, click ‘Send another request to my Microsoft Authenticator app’. If the request 


expires, re-enter your account and password in the DataLab log in screen. 
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example.user@mydata.abs.gov.au 


We didn't hear from you 


We sent an identity verification request to 
your Microsoft Authenticator app, but we 
didn't hear from you in time. View details 


Send another request to my Microsoft 
Authenticator app 
Having trouble? 


Enter a security code from your Microsoft 
account or authenticator app instead. 


If you can't use an app right now, get a 
code a different way. 


You can also change the way you approve the sign in request by selecting "I can’t use my Microsoft Authenticator app right 


now". 
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Approve sign-in request 


rs) Open your Authenticator app, and 
"enter the number shown to sign in. 


No numbers in your app? Make sure to 
upgrade to the latest version. 


| can't use my Microsoft Authenticator app right 
now 


More information 


You then have two options: 


1. approve a request on your phone app 


2. use a verification code from your phone app 
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example.user@mydata.abs.gov.au 


Verify your identity 


Approve a request on my 
Microsoft Authenticator app 


[123] Use a verification code 


More information 


Are your verification methods current? Check at 
https://aka.ms/mfasetup 


Cancel 


After you approve the login in the Microsoft Authenticator application, you are logged into the DataLab portal. 
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Launch the VM 
To enter your DataLab project workspace you need to: 


1. Activate your VM (#step-1-activate-your-vm) 


2. Launch your desktop (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace/latest#step-2-launch- 
your-desktop) 


Step 1 Activate your VM 


Each project VM is displayed on individual tiles, with your “active” VM appearing at the top above those that are “locked”. For 


more information about your VMs, see Functions in My Projects. (/statistics/microdata-tablebuilder/datalab/portal- 


features#functions-in-my-projects) 
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Each project has a separate VM and you can only access one project VM at a time. If your machine is already available to 


launch, skip to Launch your desktop (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#step-2- 


launch-your-desktop) . 


e If not, click the ‘Activate’ button as shown below and wait until the ‘Connect’ button appears. 


e If your machine shows a status other than ‘Connect’ or ‘Activate’ you must rebuild the VM first. See VM management 
options (/statistics/microdata-tablebuilder/datalab/portal-features#vm-management-options) for more information. 


Click on the ‘Activate’ button of the VM you want to launch. 
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If you have a VM for another project that is currently active, this logs you out of your other session. If you have a program 
running in your Workspace using another VM, this will stop the program. You can only run multiple VMs (/statistics/microdata- 


tablebuilder/datalab/portal-features#run-jobs-on-offline-vms) if you have requested and are using offline local disk space. 
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As shown below, you can track the VM activation progress by either selecting 'Track' from the pop up notification or from the 
action log icon on the left navigator. 
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When the VM activation completes, an additional pop up notification confirms that the action was successful. If the action 
fails, repeat the above steps to activate. 
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If you navigated to the Action Log page, select the laptop icon named 'My Projects’ in the left navigator to return to the 'My 
Projects' page. 


Step 2 Launch your desktop 
Launch the VM by clicking the ‘Connect’ button on the active VM tile. 


Prior to launch, you will have a choice of the type of connection you wish to utilise from the drop-down menu, as shown in the 


image below. Azure Virtual Desktop (AVD) provides the option to select between a web browser user experience OR 


downloaded application if required (via the 'Remote Desktop client’). 


Note: If you want to use multi-screen functionality, we advise you connect via the 'Remote Desktop Client’ for Windows 


version. This version may also improve connection stability and VM screen resolution. 


V320777 a 
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CONNECT (WEB CLIENT) 


Connect (web client) 


Connect (Remote Desktop Client for Windows) 


Other ways to connect... 


This image shows three options from the drop-down menu when selecting ‘connect’ to launch your AVD VM. The first option 
is “Connect (web client)", the second is “Connect (Remote Desktop Client for Window)", and the third option is for “Other 


ways to connect”, which will bring up another menu to show other launch options. 


Connect (web client) option 


If you are connecting to the 'web client' version of AVD, a new browser page will launch, showing the settings screen below. 
This window may have slightly different options for each device. There is no need to change any of these settings. Press 


‘Connect’ to continue. 


In Session Settings 


Select the devices or features your resource can use. 


iv | Microphone 


Show Advanced Settings 
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You will then be asked to log into your VM using your DataLab credentials. Once you have entered your credentials, click 'Sign 


In‘. 


Verify your identity and sign in with your work account. 


ter username 


After a successful login, you will see the below loading screen. 


Your VM will then prepare Windows for you. 


Other user 


Preparing Windows 


Note: You may see an upload button in the toolbar which, intentionally, does not work. You may encounter a success message 


after uploading but you will not be able to retrieve any files that you have uploaded. If you wish to upload data or packages to 


Connect 'Remote Desktop Client for Windows' option 


If you are connecting to the 'Remote Desktop client' version of AVD, ensure that your IT department has enabled the correct 


networking addresses. See Enabling access to the Datalab (/statistics/microdata-tablebuilder/datalab#enabling-access-to- 


datalab) under 'Azure Virtual Desktop configuration’ for more information. 


Note: If you intend to use the 'Remote Desktop client' on your organisation's workspace, you will need to contact your internal 


IT department to make it available to you. 


The latest version of 'Remote Desktop client (MSI)' for Windows, ensuring you select the 'MSI' version is available here 


(https://learn.microsoft.com/en-us/azure/virtual-desktop/users/connect-windows?pivots=remote-desktop-msi#download- 


and-install-the-remote-desktop-client-msi ) and for Macintosh is available here (https://learn.microsoft.com/en-us/azure/ 


virtual-desktop/users/connect-macos#beta-client) . 


Note: For the windows version of the Remote Desktop client, the only supported version is the ‘MSI' version. Other versions, 


including the Microsoft store version, are not supported and may lead to issues with launching and connecting with your VM. 


Once you have access and have started the application, click ‘Subscribe’ as shown below. 
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Subscribe with URL 


You will then be shown a new window that allows you to log into your DataLab account using your DataLab credentials. 


Let's get started 


= Microsoft 
Sign in 
| 


aN Sign-in options 


Terms of use = Privacy & cookies 


Upon a successful login, you will be shown all your available VMs. If you can't see the VM that you want, it may be dormant 


and would require a rebuild. 
If you have access to multiple projects you may be shown multiple tabs, one for each project as shown in the image below. 


Note: If you wish to use multi-display, right click on your VM icon, click ‘Settings’, and turn off ‘Use default settings’. You 


should now see options for how you would like to display your VM. 
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ABS DataLab Project 


ABS DataLab Project brick07 


ABS DataLab Project 


Click into one of the computer icons and you will be taken to a login screen to reconfirm your identity, before access is 


granted to enter your VM. This may not appear if you have recently logged in, through a similar window. 


|@ remote Denton  - 2 xi 


bey Settings FA Tite 


> ABS DataLab Project 
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v ABS DataLab Project 


ME 122.205 q0v.0 


Enter password 


important Notice If you are not 


The below loading bar should briefly appear. 


"> Remote Desktop 


Connecting to: 
brick07 


Initiating remote connection... 


If, instead of the second login prompt, you receive a message as shown in the below image, then either your machine is not 
the active machine or it is not using the AVD version ‘2024avd' or similar. If your desktop session does not start, repeat Step 1 


Activate your VM (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#step-1-activate-your-vm) and 


check that the version at the bottom of your VM says '2024avd' or similar. 


Remote Desktop 


We couldn't connect because there are currently no available resources. Try again later or 
contact tech support for help if this keeps happening. 


See details 


For more tips on how to resolve the issue, refer to the Troubleshooting Guide 


You will then be presented with another login screen for the VM itself. 


Windows Security 


Enter your credentials 


These credentials will be used to connect to ABS DataLab Project 
brick07. 


[ ] Remember me 


@) 4 Cancel 


You should then have a new window open on your computer with your VM desktop open. 


For more information on using the workspace see Using your workspace (/statistics/microdata-tablebuilder/datalab/using- 


your-workspace) 


First time use/new phone steps 


The DataLab uses two factor authentication to provide a secure log in environment. You need to download the Microsoft 
Authenticator app to your smart phone to use the DataLab. 
Open https://datalab.abs.gov.au (https://datalab.abs.gov.au) and enter your credentials. 


The first time you log in, enter the username and password provided to you by the ABS. 


If you are using a new phone, refer to the Contact us (/statistics/microdata-tablebuilder/datalab/contact-us) page for system 


support. An ABS system administrator will need to reset your Authenticator. 


Note: all DataLab accounts use the @mydata.abs.gov.au domain format. 
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Statistics 


< example.user@mydata.abs.gov.au 


Sign in 


Enter password 


example.user@mydata.abs.gov.au 


seeeeeeesececes 


Can't access your account? 


Forgotten my password 


Next 


If you are switching to a new phone (not new account) you will be given the screen ‘More information required’, click ‘Next’. 
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Australian 


Bureau of 
Statistics 


example.user@mydata.abs.gov.au 


More information required 


Your organisation needs more information to keep 
your account secure 


Use a different account 


Learn more 


Next 


This will direct you to Step 1 of setting up your Microsoft Authenticator application. Download the Microsoft Authenticator app 
to your smart phone from the App Store (//apps.apple.com/au/app/microsoft-authenticator/id983156458) (for iOS) or Google 
Play (https://play.google.com/store/apps/details?id=com.azure.authenticator&hl=en_AU&gl=US) (for Android). Make sure that 
the authenticator is published by Microsoft, as the ABS DataLab only supports Microsoft Authenticator. 


Microsoft Authenticator @) 


Protects your online identity 
Microsoft Corporation 


#1 in Productivity 
KKKKK 48 38.5 


Free 


Once you have fulfilled the initial requirements noted for Step 1, proceed by clicking ‘Next’. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 
Method 1 of 2: App 


@ : 


App Phone 


Microsoft Authenticator 


Start by getting the app 


On your phone, install the Microsoft Authenticator app. Download now 


After you install the Microsoft Authenticator app on your device, choose "Next". 


You will then be guided to open your downloaded Microsoft Authenticator app and add a ‘Work or school account’. 


| want to use a different authenticator app 


€ Add account 


What kind of account are you adding? 


4 Personal account @ 


HH Work or school account @ 


Other account (Google, Facebook, etc.) © 


Once complete, click ‘Next’. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 
Method 1 of 2: App 


@ : 


App Phone 


Microsoft Authenticator 


Start by getting the app 


On your phone, install the Microsoft Authenticator app. Download now 


After you install the Microsoft Authenticator app on your device, choose "Next". 


| want to use a different authenticator app 


The following screen presents a QR code to scan using your Microsoft Authenticator app. 


Method 1 of 2: App 


@ 


App Phone 


Microsoft Authenticator 


Scan the QR code 


Use the Microsoft Authenticator app to scan the QR code, This will connect the Microsoft Authenticator 
app with your account. 


After you scan the QR code, choose "Next". 


| Can't scan image? | 


Initiate the scanning function on your phone, then hover your phone over the QR code shown on your browser screen. 


Add work or school account 


ie Scan a QR code 


Scan QR code 


Your account provider will display a QR code 


Or enter code manually 


Once scanning is complete, click ‘Next’ on your browser screen. You will be asked to enter the security number shown on 


your browser screen into your Microsoft Authenticator app, once complete, click ‘Next’. 


Keep your account secure 
a Are you trying to sign in? 


Your organisation requires you to set up the following methods of proving who you are. 


Method 1 of 2: App MyData 
(7) example.user@mydata abs.gov.au 


App Enter the number shown to sign in. 


Enter number here 


Microsoft Authenticator 


Let's try it out 
YES 


Approve the notification we're sending to your app by entering the number shown below 


NO, IT'S NOT ME 


| CAN'T SEE THE NUMBER 


After entering the security number and receiving approval from your Microsoft Authenticator application, you will see a 
‘Notification Approved’ confirmation on your browser. Click ‘Next’ to proceed to Method 2 of setting up your multi-factor 
authentication. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 
Method 1 of 2: App 


7) 


App Phone 


Microsoft Authenticator 


iv) Notification approved 


Y 


~ = 


To make sure you can reset your password in the future, you also need to set up an authentication phone and/or email. The 


system will verify you by the option you select. 
Authentication by phone 
The system verifies your phone by the option you select. 


Select your region from the drop-down menu, enter your mobile number and choose between receiving a text or a call to 
activate the verify button. Enter the code then select ‘Next’ to verify. The call option sends you an automated phone call that 
will ask you to press the # key to verify. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 


Method 2 of 2: Phone 


App Phone 


Phone 


You can prove who you are by answering a call on your phone or texting a code to your phone. 


What phone number would you like to use? 


| Australia (+61) CD) 


@ Text me a code 


C) Call me 


Message and data rates may apply. Choosing Next means that you agree to the Terms of service and Privacy 


and cookies statement. 


| want to set up a different method 


Method 2 of 2: Phone 
App Phone 
Phone 
We just sent a 6 digit code to +61 04 Enter the code below. 


Resend code 


| want to set up a different method 


Once verified, select ‘Next’ and then ‘Done’ to return to the sign in page. 


Method 2 of 2: Phone 


App Phone 


Phone 


iv) SMS verified. Your phone was registered successfully. 


Method 2 of 2: Done 
App Phone 


Success! 


Great job! You have successfully set up your security info. Choose "Done" to continue signing in. 


Default sign-in method: 


wy Phone 
+61 


lam 
Microsoft Authenticator 


one 


Authentication by email 


Click the ‘I want to set up a different method’ and select ‘Email’ from the drop down menu. 


Choose a different method 


Which method would you like to use? 


Choose a method (~]) 


Phone 


Email 


Enter an email address then click ‘Next’. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 


Method 2 of 2: Email 


App Email 


Email 


What email would you like to use? 


A verification code is emailed to you. Enter the verification code and select ‘Next’. Once you have set up your details, select 
‘Done’ to return to the sign in page. 


Keep your account secure 


Your organisation requires you to set up the following methods of proving who you are. 


Success! 
Great job! You have successfully set up your security info. Choose “Done” to continue signing in 
Default sign-in method: 


Email 


Done 


Set up a new password for your account. Your password cannot contain your user ID. It must be a minimum of 8 characters 


and contain at least three of the following: 


¢ upper-case letters A- Z 
e lower-case letters a - z 
* numbers 


° special characters @#$%*&*-_!+=[]{}|\:',.2/°~"(Q); 


oy, AUSTRALIA oe 
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Australian 
Bureau of 
Statistics 


example.user@mydata.abs.gov.au 


Update your password 


You need to update your password because this is 
the first time you are signing in, or because your 
password has expired. 


You can then log in to your account using your new password. 


Reset your password 


If you forget your password click on the ‘Forgotten my password' link. If you have received a notification to reset your 
password while in your VM, log out and then click on the ‘Forgotten my password' link. 


ty AUSTRALIA rg 
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Australian 


Bureau of 
Statistics 


€ example.user@mydata.abs.gov.au 
Enter password 
Passw ord 


Your user ID is populated for you. Enter the characters in the picture, or words in the audio, then click 'Next'. 


Australian 
Bureau of 
Statistics 


Get back into your account 


Who are you? 
To recover your account, begin by entering your email address or username and the characters in the picture or audio below. 


Email or Username: * 


example.user@mydata.abs.gov.au 


Example: user@contoso.onmicrosoft.com or user@contoso.com 


Enter the characters in the picture or the words in the audio. * 


The next screen takes you to Step One of verifying your account. Choose from the options in the left-hand column (options 
available depend on what you chose during your original account set up process). 


Australian 
Bureau of 
Statistics 


Get back into your account 


verification step 1 > choose a new password 


Please choose the contact method we should use for verification: 


© Email my alternative email 


dd You will receive an email containing a verification code at your alternative email 
address ‘ 
address (ex********@organisation.gov.au). 


O Send a text to my mobile phone 


number 


Email 


O call my mobile phone number 


Verify your account information via email, text, or call (whichever you chose), and follow the prompts to reset your password. 


The screen below displays when your password has been reset. Click the link to sign in with your new password. 


Australian 


Bureau of 
Statistics 


Get back into your account 
@ Your password has been reset 


To sign in with your new password, click here. 


Using your workspace 


Getting started, accessing your data files, available software, locking your workspace and signing 
out 


Released 4/11/2021 
Getting started in the DataLab workspace 


When you have successfully logged into your Virtual Machine (VM) instance, your DataLab workspace looks like this: 


By ABS Detaled test02 - Desktop Viewer - o x 


9:39 PM 


") of 
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You can use DataLab in a similar way to using other secure networked systems, where you can securely see, use and share 
data files, analysis and output with the other members of your project team. 


Open File Explorer and click on This PC to see the network drives you have access to: 


Drive C can be utilised to run scripts and create new Python package virtual environments, not facilitated through either 
Jupyter Notebook, JupyterLab or Spyder. NOTE: Do not use the C drive to save your data or scripts permanently. Though 
you may be able to temporarily save files there, the drive is destroyed on each 30 day rebuild and any information stored 
there becomes unrecoverable. 


Library (L drive): All researchers can see all files in the Library drive. This is where we upload support information, such as 
statistical language documentation, ANZSIC classification and general access guides for non-standard products. Files 
cannot be saved to this drive. 


Output (O drive): Any output you want the ABS to clear should be saved to this drive. Only members of your team can see 
this drive. See also Request output clearance (/statistics/microdata-tablebuilder/datalab/input-and-output- 
clearance#request-output-clearance) . Information is backed up nightly and retained for 14 days. Information in this folder 
remains unaffected by a rebuild. 


Project (P drive): A shared space for your team to work in and store all your project files, as well as set up and run Python 
and R scripts. Only members of your team can see this drive. Information is backed up nightly and retained for 14 days. 
Information in this folder remains unaffected by a rebuild. The default storage is 1TB. You will need to review and delete 
unnecessary files as your project files grow over time. If necessary, an increase to this storage can be requested via the 
Contact us (/statistics/microdata-tablebuilder/datalab/contact-us) page. There may be a cost for additional storage. 


Products (R drive): Access data files that have been approved for your project. However, it is best to use the My data 
products (#accessing-your-data-files) shortcut on your desktop as this shows you only the datasets you have been 
approved to access, rather than all dataset short names. Files cannot be saved to this drive. 


Local Disk (X drive): If you have been granted local disk space, this can be used to run jobs on offline virtual machines (/ 
statistics/microdata-tablebuilder/datalab/portal-features#run-jobs-on-offline-vms) (desktops). You may want to request 
this option if you have multiple projects that you are actively involved in. There may be a cost associated with attaching 
local disk space to your VM. The local disk will only be present if it has been allocated to your VM. To request local disk 


space contact the ABS via the Contact us (/statistics/microdata-tablebuilder/datalab/contact-us) page 


e Drives A and D are not to be used. Information saved here is either destroyed with each nightly shutdown and 30 day 
rebuild, or has restricted access. Attempting to read or write from Drives A or D will invoke a group policy error due to 
access controls. In this case please use the C drive or consult your project lead to request local disk space. 
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Devices and drives 
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If your network drives do not appear in File Explorer, you can click the 'Refresh Network' shortcut on the desktop. A 


confirmation message appears when this has been successfully refreshed. 


Accessing your data files 


To access the data files for your project, use the 'My Data Products’ shortcut on your desktop. 


The My Data Products folder displays only the products approved for your project. 


e) My Data Products 


‘S) New 


> My Data Products 


Name Date modified 


| lucky13 10/23/2023 3:21 PM Shortcut 


Gl Desktop ‘Tl sead-test 10/23/2023 3:21 PM Shortcut 


& Downloads 
J Documents 
PR Pictures 
© Music 


£3 Videos 


WD This Pc 


> QW Network 


2 items 


Selecting the 'Products' drive shows you the short name of all data loaded to the DataLab. However, if you try to open a file 
that is not approved for your project you are denied access and receive an error. 
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Network Error x *K Search Product 


ls, Windows cannot access Type 
\\prdct3l3cppb file.core.windows.net\Products\dataproductshellexample 
File folder 
You do not have permission to access \\prdct3l3cppb.file.core.windows.net\Products\ ; 
lj dataproductshellexample. Contact your network administrator to request access. File folder 
iL For more information about permissions, see Windows Help and Support File folder 
3 File folder 
RQ Pictures ¥ ae pew ene erreee weep erre—nerr—rer File folder 
siete » Da sead-test 10/10/2023 11:39 AM File folder 


Available software 


Software can be opened using the shortcuts on your desktop or by using search on the Taskbar. 
All researchers have access to these applications in the DataLab: 


e LibreOffice 7.5 


Acrobat Reader 


e Notepad ++ 8.5.2 
¢ QGIS 3.30 

e WinMerge 2.16 

e Git 2.40 

e Stata MP18 

e CUDA 12.1.1 


e R 411.3. including: 
e RStudio 2023.03 


e RTools 42 


e Python 3.9 (Anaconda3 distribution) including: 
e Jupyter Notebook & JupyterLab 


¢ Spyder 


e PostgreSQL 15 
e 7Zip 


If required, you can also request: 


e SAS 9.4 


e Azure Databricks 


Microsoft Word and Excel are not currently available, as these applications require an internet connection, which is not 
supported in a secure system like DataLab. Libreoffice is the alternative offered in the system, with similar capabilities to 
Microsoft Office. 


Firefox and Edge are available to support access for Databricks (which is under development) and for Jupyter notebooks to 


use Python/R. These browsers cannot be used to browse the internet. 


If a package in your statistical software choice is not available, you can request it using the Contact us (https:// 


www.abs.gov.au/statistics/microdata-tablebuilder/datalab/contact-us) page. 


Managing your R & Python packages (/statistics/microdata-tablebuilder/datalab/using-your-workspace#managing-your-r- 


python-packages) explains how you can manage R and Python packages using the Posit Package Manager shortcut on your 


desktop. 


Databricks 
Databricks is available to projects within the DataLab as a non-standard product. 
What is Databricks? 


Databricks is a cloud-based Big Data processing platform which provides users with an integrated environment to collaborate 
on projects and offers a range of tools for data exploration, visualisation and analysis. Within the Databricks environment, 


users can: 


e Build pipelines for streaming data processing. 


Build and run machine learning tools. 
e Create interactive dashboards. 


e Take advantage of scalable distributed computing capability. 


Project analysts will also have access to the Databricks Academy training subscription (an online library of Databricks training 


guides), in addition to instruction materials on how to setup the Databricks workspace provided in the ABS shared library. 


How do | allocate a Databricks workspace to my project? 


To allocate a Databricks workspace to your project, you will need to submit a request to data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) . Once your project is allocated a Databricks workspace, it can be accessed from within 


your VM using the installed Edge or Firefox browsers. 
How will costing work? 


Access to Databricks will be charged per project on a financial year basis. Projects will have the flexibility to select between a 
low or high usage profile, each with its own charging profile. Selecting the appropriate usage profile is determined by how 
much compute resources project analysts are estimated to consume. The same level of service is applicable across both 


profiles. 


Usage will be monitored by the ABS and project leads will be advised if their usage is projected to exceed the charges paid. 
Should projects exceed the usage of their profile within the financial year, access to this service can be ceased or continue 


subject to additional charges. Please see our DataLab charges (https://www.abs.gov.au/statistics/microdata-tablebuilder/ 


datalab) for more information. 


As Databricks uses separate compute power, projects requesting access to Databricks should consider if they need to 
continue to maintain their existing VM sizes. The option of scaling down the size of existing VMs provides users the 


opportunity to save on project costs. 

What are the cluster policy arrangements? 

User analysts can be provisioned with the following cluster policy options: 
Instance: DS3 v2 


e Server purpose: General purpose 
e Max autoscale workers: 5 

e CPU: 4 

e RAM/Databricks Units: 14GB/0.75 


Instance: D13 v2 


e Server purpose: Memory optimized 
e Max autoscale workers: 4 

e CPU: 8 

e RAM/Databricks Units: 56GB/2 


Instance: DS3 v2 


e Server purpose: Compute optimized 
e Max autoscale workers: 4 


e CPU: 16 


RAM/Databricks Units: 32GB/3 


Databricks cluster policies will restrict the type and number of workers you can provision for a cluster. If an existing policy 
does not fit your requirements, you can request a new policy via the ABS. All information regarding this can be found in the 
ABS shared library. 


To ensure the security and integrity of the DataLab, clients will not have administrative access to the Databricks workspace 
and some usage restrictions may apply. Administration will be exclusively managed by the ABS, aligning with the specified 


usage restrictions of the DataLab. 


Please contact data.services@abs.gov.au (mailto:data.services@abs.gov.au) with any questions. 


Managing your R & Python packages 


If you are working with a specific set of R and/or Python packages, you can now manage these using the Package Manager 


shortcut on your desktop. 


In the Package Manager, click 'Get Started’ to navigate to the available packages. You can use this tool to search for 
packages (in the left column) and install the packages you want to use for your project. If the packages you need are not 


listed, you can request them using the Contact us (/statistics/microdata-tablebuilder/datalab/contact-us) page. 
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Virtual machines 
What are virtual machines? 


Virtual machines, or VMs, are the virtual workspaces you use to undertake your analysis in the DataLab. VMs are created by 
the ABS as part of the project establishment process, described in About DataLab (/statistics/microdata-tablebuilder/ 
datalab#what-is-datalab) . 


You have one VM for each project. This is a design feature to prevent data from one project being accessed by another 
project. You can run analysis on multiple virtual machines at the same time, but only if you have been granted local disk 


space. See Run jobs on offline VMs (/statistics/microdata-tablebuilder/datalab/portal-features#run-jobs-on-offline-vms) 


(desktops). You may want to request this option if you have multiple projects that you are actively involved in. 
Virtual machine sizes 


The ABS offers standard and non-standard VM sizes. Standard VMs are included in the DataLab annual fee (/statistics/ 


microdata-tablebuilder/datalab#cost) , whereas non-standard VMs are subject to additional charges as they are more 


expensive to run. For more information on charges, see DataLab charges (/statistics/microdata-tablebuilder/datalab#cost) . 


Researchers may request access to a non-standard machine for performance or productivity purposes. If you require a non- 
standard machine, you will need to consult your project lead and your project lead will need to send the ABS an updated 


project proposal. 


Currently offered VMs and approximate running costs are listed in the tables below. 


Standard virtual machines 


Large VMs are provided as the default and most projects operate efficiently with this size. 


If you have a small or medium machine, it can be upgraded to a large at no additional charge. Please contact 


data.services@abs.gov.au (mailto:data.services@abs.gov.au) for further assistance. 


Standard Virtual Machines 


CPU 
Name RAM _ Approx cost per hour ($AUD) 
Cores 
Small 2 8GB ; é ; p , a ; . 
Not applicable - these virtual machines are included in the DataLab annual fee. (/statistics/microdata-tablebuilder/ 
Medium 2 16GB 


datalab#cost) 
Large 8 6.4 |G B ies 


Non-standard virtual machines 


Non-standard machines are available on request. 


Charges for non-standard VMs are a minimum charge. Should users exceed the minimum charge for their non-standard VM, 
access to this service can either be ceased or continue subject to additional charges being applied. Please refer to DataLab 


charges (/statistics/microdata-tablebuilder/datalab#cost) for more information. 


Note: VMs continue to incur running costs if the VM has not been stopped, even when not in use. The ABS recommends 
researchers shut down their machine during periods of inactivity to avoid unintended charges. Disconnecting, or closing your 


machine window, is insufficient. VMs are required to be shut down completely as per the VM Management Options (https:// 


www.abs.gov.au/statistics/microdata-tablebuilder/datalab/portal-features) to avoid continued running costs. 


If you have any questions or require further assistance, please contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) . 


Non-standard Virtual Machines 


Name CPU Cores RAM Approx cost per hour ($AUD) 
X-Large 16 128GB $1.80 
XX-Large 32 256GB $3.80 
XXX-Large 64 504GB $6.40 


Specialised and custom non-standard virtual machines 


The following specialised VMs (also non-standard) capable of supporting machine learning and high-performance computing 
can also be requested, however these are assessed on a case by case basis with the appropriate justification, and are subject 
to quote. If the required VM is not listed, the ABS may be able to provide a customised option at an additional charge, please 

be sure to describe why the available machines do not meet your needs in any justification provided. A list of virtual machines 


by region can be viewed via the Azure website (https://azure.microsoft.com/en-us/explore/global-infrastructure/products-by- 


region/?products=virtual-machines) . 


Assigned names of VMs are unrelated to Azure naming conventions. ABS review our provided VM options periodically, please 


revisit this page for any updates. 


Specialised and Custom Non-standard Virtual Machines 


Name CPU Cores RAM GPU Approx per hour cost ($AUD) 
Large GPU 8 56GB Tesla T4 16GB $1.50 
X-Large GPU 16 10GB Tesla T4 16GB $2.40 


Sign out or disconnect from your DataLab session 


If you need to close your DataLab session but want to keep your analysis running, you can sign out or disconnect from the 
VM. Your programs will keep running until 10pm if you've turned on the ‘Bypass’ option, the shutdown will occur at a later date 


at the same time. 


To sign out of your workspace, click on the button at the top right of your window that shows your initials, then select ‘Sign 
Out’. 


se © ®& 


Example User 


EU example.user@mydata.abs.gov.au 


To disconnect from your session, first click on the Start menu and then select the power symbol. An option to ‘Disconnect’ will 


appear. Selecting this will immediately disconnect you from the session. 


Please note that the session window will remain visible until you close the tab. If you’re using the web client version of AVD, 


you might need to minimise your window to see the tab closure option. 


{63 Sign-in options 


() Shut down 


©) Restart 


e@ Example User 0) 


! Disconnected 


Your session was disconnected. 


If you want to close your session and end all programs you have running, simply shut down your DataLab session. 


To shutdown your session, first click on the Start menu and then select the power symbol. An option to ‘Shut down’ will 


appear. Selecting this will immediately shutdown your session. 


{63 Sign-in options 


2 Disconnect 


©) Restart 


$ Example User 0) 


Portal features 


My Virtual Machines, My Accounts and My Projects 


Released 4/11/2021 
The DataLab portal is where you will find information about your DataLab account, projects and virtual machines (VMs). 


DataLab Always fo sible Us s gk wnars New! (5) citrix @® About 


A Reminder: As of 30/04/2024 Azure Virtual Desktop (AVD) is the only option to access your virtual machine following your next rebuild. AVD 


mM Projects 
= My Pree provides the option to select between a web client or desktop application. Refer to our website or recent emails for more information. 


@ Action Log 2 
My Projects Global information 
& my Account links & account 
ACTIVE PROJECT MACHINE details display here 


Important messages 
display here 
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ABS Standard 


Active VMs display here 


OTHER PROJECT MACHINES (CURRENTLY LOCKED 
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The DataLab portal displays information across three tabs: 

My Projects 

From this tab you can activate, start and launch the VM associated with your project. 
My Account 

Use this tab to view your personal contact information and basic account settings. 
Action Log 


Keeps a record of your portal actions. This can help you manage your sessions and provides useful information if you 
encounter problems with the system. It includes: 


e starting VM 

e stopping VM 

e changing your Active VM 
e restarting VM 

e rebuilding VM 


Left navigator menu 


The left navigator menu contains shortcuts that can be used to navigate between pages. Click the arrow to collapse or expand 


the navigator menu. 


Fel My Projects 


@ Action Log 


& My Account 


ABS DataLab version 38 


© Australian Bureau of St 


4 Collapse 


Global links 
The links at the top right are available from all pages of the portal: 


e What's New acts as a global information centre for the DataLab, showcasing information about new features and updates 


e DataLab Workspace (/statistics/microdata-tablebuilder/datalab/using-your-workspace) to access your VM. You must 
activate your VM before you can use this shortcut 


e About the DataLab (/statistics/microdata-tablebuilder/datalab) to access this user guide 


e DataLab Privacy Notice (https://www.abs.gov.au/websitedbs/d3310114.nsf/home/datalab+privacy+notice) 


e User Icon displays your details, including name, user name and user role. This is also where you log out of the DataLab 
Your obligations and management responsibilities 


The Responsible Use of ABS Microdata obligations guide (/statistics/microdata-tablebuilder/responsible-use-abs-microdata) 


and Using DataLab responsibly (/statistics/microdata-tablebuilder/datalab/using-datalab-responsibly) pages will help you 


understand your obligations and management responsibilities to handle microdata safely. Read through these pages or 


Contact Us (/statistics/microdata-tablebuilder/datalab/contact-us) if you would like any help understanding your 


responsibilities. 
Important messages banner 


This banner appears at the top of your DataLab portal window when we have an important message for your consideration or 


action. 
Functions in My Projects 
You must now connect to your Virtual Machine (VM) using Azure Virtual Desktop (AVD). 


Citrix will be decommissioned by June 2024. 


My Projects Perform other actions from the 


The Project ID. active pmosect macnine detailed view, such as changing 
Og I — your VM version. 


The Project name. ——____. 001 nr Select a method to connect. Click 


, ‘Other ways to connect’ for more 
Clicking ‘Connect will y 


information. 
launch the VM via the ES conccriesciue | ol 


selected method. 


cnmenepoen nomics @ <——————_ Shows auto-shutdown time 
Se 4 RUNNING Mie 
state of the VM. saeenemeen —™ Shows days until next 
Click to start or stop OTHER PROJECT MACHINES (CURRENTLY LOCKED) scheduled rebuild 
the VM. : 
002 MANAGE 


An example project 


In order to switch 
between approved 
Projects, click ‘Activate.’ 


> ACTIVATE 7 
EE — Shows the size, type, and 
. : version of the VM 


VM management options 


In the 'Manage' menu you will be able to switch your Citrix version, labelled '2024', to the new AVD version, labelled 
'2024AVD'. 


The web version of AVD is selected by default and will launch in a new browser tab. However, you may choose to install the 
Remote Desktop Client (for Windows or macOS). Connecting via the web client is the simplest option, but the desktop client 
may support additional features and display options. 


0000003 


ABS Standard 


CONNECT (WEB CLIENT) v 


() OFF 25 days 'G 


SIZE | LARGE TYPE | STANDARD VERSION | 2024AVD 


My Projects > 0000003-4spNHs 


Project Details Power State 
=e) START VM PD 2) 
tine ABS Standard 
Project ID 0000003 
Availabte in 
Storage 0000003mfsvb nee 
Account 


Scheduled Shutdown 


BYPASS SHUTDOWN © 127) 


prdct4fzchabs 
Next Due Tonight 10PM AEST 
Description ABS Standard Testing 
Start Date 17/12/2021 Scheduled Rebuild REBUILD NOW #& +?) 
End Date 17/02/2027 Next Due 23/12/2023 11:00 PM 


Machine Details 


If your VM is dormant, no management options are available. 


DataLab 


IB) My Projects My Projects > y38-e4cg0q 


& The VM is currently dormant. It cannot be accessed until the machine is rebuilt 


REBUILD NOW 


Project Details Desktop Version CHANGE VM VERSION | VERSIONS @ 


Example Project Type standard 


Windows 11 Enterprise Edition, R 4.3, RTools 43, RStudio 2023.03, 
An da3 2023.03, Stata/MP 18, SAS 9.4 (when VM Type is SAS 
only), CUDA 1 1, LibreOffice 7.5, PostgreSQL 1 zip 2201 
Notepad++ 8.5.2, WinMerge 2 16, QGIS 3.30, Git 2.40 


prdct3Scpabs This ts the latest version 


iby 
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The contents of each pane on this screen are outlined as follows: 


Power State: You can start, stop, or restart the VM. please consider stopping your VM when you have finished work, this may 
save on costs if you are using a non-standard machine. 


Power State STOP VM @ RESTARTVM 4 9 


Power State RUNNING 


Available in 
DataLab 
Workspace 


< 
m 
” 


Scheduled Shutdown: VMs are automatically shutdown every night at 10pm AEST. If you have a program running that you 


expect to run past 10pm, you can choose to extend your session for up to 3 days by selecting 'Bypass shutdown’. 


Scheduled Shutdown Q 


Next Due Tonight 10PM AEST 


Scheduled Shutdown CANCEL x 2) 


Automatic shutdown of this Virtual Machine can be bypassed for up to 3 days. It will be bypassed until 10:00 PM 
of the selected day. 


DEFAULT TUESDAY (1 WEDNESDAY (2 THURSDAY (3 
(TONIGHT) NIGHT) NIGHTS) NIGHTS) 


SUBMIT 


Scheduled Rebuild: VMs are automatically destroyed and rebuilt every 30 days for security and maintenance purposes: 


* you cannot extend this time, however you can choose to rebuild before the schedule time by selecting ‘Rebuild Now’ 


it displays a date and numbered count down on the coloured bar, with time adjusted to your local area 
the coloured bar changes, starting with green, moving to orange, and finally red as you get closer to the rebuild date 
after rebuilding the countdown resets to 30 days and allows you to bypass the nightly shutdown 


if you try to bypass a shutdown when your machine is scheduled for a rebuild, the system will deny the action, but offer to 
‘Rebuild Now’ 


Scheduled Rebuild REBUILD NOW & @ 


Next Due 09/11/2023 11:00 PM 


Run jobs on offline VMs 


If you are an analyst who works across multiple projects, you can request local disk space. This will enable your VM to run 


jobs offline, noting the 30 day rebuild still applies. 


Datasets are stored on a remote file share. Only the active machine has network access to this location. Your locked virtual 
machines do not. To run offline jobs, you need to request local disk space to be attached to your machine. There may be a 


cost associated with this. 


When running jobs offline, the inactive machine can continue to run your program as it still has access to the data since it is 
no longer using the remote file share. However, working like this does not allow your project team to see your analysis or 
output. You should always move your output back to your Project or Output drives where your project team can access and 


review the output. See Using your workspace (/statistics/microdata-tablebuilder/datalab/using-your-workspace) for more on 


the available drives in DataLab. 


To use local disk space: 


1. Request access to a local disk for your project through the Contact Us (/statistics/microdata-tablebuilder/datalab/contact- 
us) page 


. Copy the data products you need to the local disk. 
. In your program, point to your source/input data on the local disk and start the job. 
. In your program, save your output to the local disk. 


. Exit your VM and return to the DataLab portal to activate another machine. 


oOo a fF W DN 


. After you have finished running your analysis offline (local disk) move your analysis and output back to your Project drive. 


Devices and drives 


4 Windows (C:) Temporary Storage (D:) 
= lt bl 
70.5 GB free of 126 GB oa 29.5 GB free of 31.9 GB 


Local Disk (X:) 


31.8 GB free of 31.9 GB 


Functions in My Account 


Select the ‘My Account’ tab from the navigation panel to see details about your account. 


fal My Projects 


@ Action Log 


& MyAccount 


& My Account My Account 


Basic Attributes Account Settings 
example.user@mydata.abs.gov.au 
Example User 


“ise Email example. orgamsation.gov.au 


Australian 
Bureau of 
Statistics 


02 5555 4444 


16 Dec 2020 


ACTIVE 


Basic attributes displays your name, email, phone etc. If your personal details are incorrect, please Contact Us (/statistics/ 


microdata-tablebuilder/datalab/contact-us) with the correct information. 


Account settings allows you to opt in or out of receiving email reminders. These reminders let you know when your virtual 
machine will shut down. Notifications are sent at 59m AEST/AEDT, prior to the 10pm scheduled shut down if you have started 
your VM that day. It will also remind you before your 30 day VM rebuild. You can change this option at any time by clicking 
‘Edit’. 


My Account ’ Edit Account Settings 


Opt out of reminder emails 


Recommended browsers 


DataLab is presented in a web browser. It is recommended the latest version of either of the following are used: 


e Chrome 
e Microsoft Edge 
e Firefox 


¢ Safari 
Internet Explorer is not recommended. 


Note: Mobile devices are not supported/enabled for the DataLab. 


Troubleshooting 
Help with logging in, virtual machines, errors and running out of space, code and software 


Released 4/11/2021 
myDATA user portal 


For help with myDATA, see myDATA troubleshooting (/statistics/microdata-tablebuilder/datalab/getting-started-mydata) . 


Authentication 


I'm having trouble with my Multi-Factor Authentication 


If your DataLab account name is not recognised by your authenticator application, it may be because you have downloaded 
an authenticator not published by Microsoft. The ABS DataLab only supports Microsoft Authenticator. 


You will need to download the Microsoft Authenticator application to your smart phone from the App Store (https:// 
apps.apple.com/au/app/microsoft-authenticator/id983156458) (for iOS) or Google Play (https://play.google.com/store/apps/ 


details?id=com.azure.authenticator&hl=en_AU&gl=US) (for Android) to fulfil the login sequence. 


a authenticator app microsoft Q Y 


Microsoft Authenticator 


Microsoft Corporation 


4.6% 50M+ 
1M reviews © Downloads Rated for 3+ © 
Sign in without Sign in with your Autofill px: More security, for 


all onic moons ema 


et ee obese on aDDSs 4 


The following authenticator applications (similar in appearance to the Microsoft Authenticator) will not function with the ABS 
DataLab: 


Oke 


Authenticator App: Authenticator Authenticator App: Mi 
2FA & MFA 45% 2FA Authen 4. 
5.0* 


If you have verified you are utilising the correct application, but are not receiving prompts to authenticate on your mobile 
device, check your battery optimisation is turned OFF by following these steps. 


1. Open Microsoft Authenticator, and refer to the top right-hand corner, if there is a red dot above the three white dots, press 
this and then select 'Allow' to turn the battery optimisation off. 


2. Then try logging in again on the DataLab landing page. You can also try to switch from WiFi to mobile data through your 
phone, to ensure a good connection to your PC/laptop. 


If you receive the ‘Error communicating with server’ message on your mobile device, and your device is connected to the 
y 


home WiFi, then please turn your phone over to mobile data and try logging in again. 


If you are switching to a new phone/tablet device, the operating system of some mobile devices may not interact as expected 
with Microsoft Authenticator (namely the iOS 16, and some older versions of Android), in this case, try setup another phone or 
tablet device. In the case that you still have your old phone it may help if the old account is removed from the Microsoft 
Authenticator application on the previous device. 


Logging in 


I can't log in 


If you have entered your user name or password using copy and paste, you may have accidentally included hidden 
characters or a space. 


Your organisation firewall may be blocking access. Try accessing DataLab while disconnected from your organisation's 
network. 


The ABS DataLab only supports use of the Microsoft Authenticator app (https://support.microsoft.com/en-us/account- 
billing/download-and-install-the-microsoft-authenticator-app-351498fc-850a-45da-b7b6-27e523b8702a) . 


If you have changed your mobile phone we need to reset your Microsoft Multi Factor Authentication, 
email data.services@abs.gov.au (mailto:data.services@abs.gov.au) . 


If you need to reset your password this must be done via the Forgot my password link in the initial DataLab sign in screen. 


Clear your browser cache. 


e Try a different browser. See Recommended browsers (/statistics/microdata-tablebuilder/datalab/portal- 
features#recommended-browsers) . 


Has my organisation authenticated my access to the DataLab 


DataLab is enabled by cloud infrastructure, which may be blocked by some organisations’ firewall settings. 


ABS cannot make changes to external organisations' infrastructure. Project Leads need to supply the information below to 


each organisation participating on this project. 
Network/IT Security sections in each organisation need to review and make changes to authenticate access. 
1. Enable authentication to the tenant 


Users need to authenticate to one of ABS Azure Active tenants, which may be strictly controlled by government agencies and 


academic workplaces. Authentication must be enabled to the tenants: 


e mydata.abs.gov.au 


e absmydata.onmicrosoft.com 
2. Allow user access to URLs 
Users will need to access the following URLs: 
e DataLab production portal: datalab.abs.gov.au and sead.abs.gov.au 


3. Configure your organisation's network to allow outbound connections to the following addresses required for Azure Virtual 
Desktop (AVD): 


e login.microsoftonline.com 
e *wvd.microsoft.com 

e *servicebus.windows.net 
© go.microsoft.com 

e aka.ms 

e learn.microsoft.com 

© privacy.microsoft.com 


e query.prod.cms.rt.microsoft.com 


These addresses all utilise the TCP protocol and outbound port 443 for communication. Contact data.services@abs.gov.au 


(mailto:data.services@abs.gov.au) for further assistance. 


Why do | have to log in twice during the access process 


The DataLab has more functionality and features available to you, so you can set options as well as undertake your research. 


e First log-in is to the DataLab portal, where you can view and set options for your DataLab account information and virtual 
machines. Read more in DataLab portal features (/statistics/microdata-tablebuilder/datalab/portal-features) . 


e Second log-in is to the DataLab workspace where you undertake your analysis. 


How long does my temporary password/password last 


e The temporary password issued to you by the ABS lasts for 90 days. After you have completed the set up steps you 
must reset your password (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#reset-your- 
password) . 


e If you have forgotten your temporary password, email data.services@abs.gov.au (mailto:data.services@abs.gov.au? 
Subject=DataLab temporary password reset needed) for a reset. 


| forgot my password to get into the DataLab portal 


Your log in credentials for the DataLab portal are the same as for the DataLab workspace. You can reset your password (/ 


statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#reset-your-password) by clicking on the Forgot my 


password link. 
My password expired while my virtual machine is running 


Your session will continue on until a shutdown is required (either nightly shutdown or 30 day rebuild). However, you can 


still reset your password (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#reset-your-password) 


while your session is running. 


Virtual machines 
My virtual machine is not launching 


1. You must Activate, then start the VM (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#activate- 


then-start-the-vm) . Follow the process and wait for each step to complete before progressing. 


2. Check your internet connection. If you have a weak or intermittent connection, this can affect launching your virtual 
machine. 


3. Try launching the virtual machine outside of your organisation's online environment. Some institutions’ or Government 
departments’ firewall or other security settings may be preventing access to DataLab portal and/or launching of the VM. 
Attempting to connect outside your agency's online environment may assist in forming the VM connection. 


4. Restart your virtual machine. As with restarting a computer, restarting your virtual machine can sometimes resolve 
problems with launching your machine successfully. From the virtual machine page click the Restart VM button and wait 10 
minutes to ensure the reboot of the machine is complete before attempting to launch again. 


5. If you are still having trouble, email data.services@abs.gov.au (mailto:data.services@abs.gov.au?Subject=My virtual 
machine is not launching) . 


Power State 


STOP VM @ RESTART VM <<) 
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RUNNING 
State 


The text or images in AVD web client is unclear 


If the text or screen resolution in your DataLab instance is ‘fuzzy’, then you can increase screen resolution by enabling 'High 


DPI' as shown in the option settings below. 


To access the option settings, in the upper right corner of the web client, you can find the setting cog. Then turn on the 


‘Enable High DPI' option to enable the higher screen resolution. 


H 7 F ® ® 


In session 


Select the devices and features that your resource 
can use. 


Microphone 


Keyboard shortcuts (Preview) 


Enable alternative keyboard layout 

Use an Input Method Editor to enter complex 
characters. You must have an Input Method Editor 
enabled in your remote session. Standard 
keyboard input may not work as expected. 


Select remote keyboard layout 
United States-International (QWERTY) 


Enable High DPI 
Enable higher screen resolution 


Show these options every time | connect 


Cancel 


| am experiencing significant input lag. 


If you are experiencing significant lag, High DPI can be turned off to reduce lag in exchange for clarity. You may also increase 


your stability with Remote Desktop client making (https://learn.microsoft.com/en-us/azure/virtual-desktop/users/connect- 


windows?pivots=remote-desktop-msi%22%20\I% 20 %22download-and-install-the-remote-desktop-client-msi) sure to use 


the (MSI) version as this is the only version we support. 
What does it mean for a virtual machine to be Active and why does this matter 


If you are a member of multiple projects in the DataLab, you will have more than one virtual machine. Your Active machine is 
the one that is connected to the remote file share, where the data files are stored. For security purposes, only one of your 


sessions can connect to the remote file share at a time (this is where data files are stored). You can activate your virtual 


machine (/statistics/microdata-tablebuilder/datalab/logging-portal-and-workspace#activate-then-start-the-vm) by using the 
Change Active VM button. 


My Virtual Machine is not launching from the Remote Desktop client 


If you receive the following error or similar to the image directly below when attempting to launch your VM from the Remote 
Desktop client. Check that your VM is using the ‘2024avd' version, that the machine you are trying to launch is ‘activated’, and 


that your machine is not currently being rebuilt. 


Remote Desktop 


We couldn't connect because there are currently no available resources. Try again later or 
contact tech support for help if this keeps happening. 


See details 


For more tips on how to resolve the issue, refer to the Troubleshooting Guide 


| want to use multiple monitors (multi-display) when accessing the DataLab 


The AVD web client does not provide support for multiple monitors. To use multiple displays when using the DataLab you will 


need to use the Remote Desktop client (https://learn.microsoft.com/en-us/azure/virtual-desktop/users/connect-windows? 


pivots=remote-desktop-msi#download-and-install-the-remote-desktop-client-msi) , making sure to use the (MSI) version as 


this is the only version we support. 


To see the menu in the image (from the Remote Desktop client), right click on the machine you want to access and click 


‘settings’, then turn off ‘Use default settings’ to see the display settings. 


© Remote Desktop Oo x 
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Why are virtual machines destroyed every 30 days 


Virtual machines are destroyed approximately every 30 days for security purposes. If the 30 day timing will interfere with the 


timing of your project, you can choose to destroy and rebuild (/statistics/microdata-tablebuilder/datalab/portal-features#vm- 


management-options) earlier than 30 days at a time that suits you. 


Is my virtual machine backed up 


Virtual machine project and output drives are backed up every night and kept for 14 days. Files outside of these drives are not 


recoverable. 
Where do | save the work | have done on a virtual machine that is scheduled to be destroyed 


Save your work to your Project or Output drives to ensure that your analysis is not lost. Information saved outside of these 
drives is destroyed when your machine is rebuilt every 30 days. 


Can | have multiple virtual machines running code at the same time 


Only if you have requested local disk space to be allocated to a machine. This allows you to run jobs on offline VMs (/ 


statistics/microdata-tablebuilder/datalab/portal-features#run-jobs-on-offline-vms) . 


I can't see my project's products 


Try logging out of and stopping your VM, then begin the Start VM process again. If that does not work, try the rebuild now (/ 


statistics/microdata-tablebuilder/datalab/portal-features#vm-management-options) from your VM management options. 


There is an upload button on my Azure Virtual Desktop machine toolbar 


The upload button that is present in your toolbar is intentionally non-functional. You may encounter a success message after 
uploading but you will not be able retrieve any files that you have uploaded. If you wish to upload data or packages to the 


DataLab, please contact the Data Services team or Input Clearance team. 
| can't use keyboard shortcuts in the AVD web client 


For AVD to capture your shortcuts you will need to enable keyboard shortcuts in the AVD settings. This can be done either in 
the pop up menu that appears while you are logging into your VM, or it can be enabled inside the VM using the settings 'cog' 
menu at the top right. You will need have your VM in 'full screen mode' to enable your shortcuts. Click on 'Enter full screen’ or 


'maximise' as seen in the image. 


On @) 


Keyboard shortcuts only work 


when the resource Is in full screen. 


My VM web client is slow or unresponsive while accessing through my organisation's environment/ 
virtual machine 


When accessing the DataLab through your organisation's virtual machine it is expected that the access would be slow given 
the multiple levels of virtualisation and processing of inputs. We recommend accessing the DataLab on your base machine or 


through the Remote Desktop client, which may alleviate some of the slow responsiveness. 


I'm experiencing performance issues within my DataLab workspace 


System performance issues can occur for many different reasons, and every issue requires a unique approach to 


troubleshoot. Many issues can be resolved by attempting one of the following: 


e Ensure you have a good internet connection 


e Close and reopen the program you are using, and close any other programs or processes that may be consuming system 
memory 


e Confirm your project drive has available space, if not attempt to free up space 


e Refresh your network drives using the icon on the workspace desktop 


Attempt to shutdown or rebuild your virtual machine 


If issues persist, email data.services@abs.gov.au (mailto:data.services@abs.gov.au) for further assistance. 


I’m unable to launch my VM through the web client (Can't access Windows 365, etc.) 


e You can try logging into the DataLab portal and the AVD web client through a private browser. If you are logging in using 
your work computer your DataLab credentials and work credentials may be conflicting with each other causing some 
access issues. 


e If this doesn’t solve your issue, you can try the ‘Other ways to connect...’ option in the drop down menu in the DataLab 
portal. Selecting ‘AVD web client’ will launch another browser window and you will just then have to select the machine that 
you want to connect to. 


e If the previous steps have failed you may need to request the Remote Desktop client from your IT department (or download 
yourself if you are using your own PC) using the link here: Connect to Azure Virtual Desktop with the Remote Desktop 
client for Windows (https://learn.microsoft.com/en-us/azure/virtual-desktop/users/connect-windows?pivots=remote- 
desktop-msi#download-and-install-the-remote-desktop-client-msi) , ensuring it is the Remote Desktop client (MSI) 
version. 


If issues persist, email data.services@abs.gov.au (mailto:data.services@abs.gov.au) for further assistance. 


Errors and running out of space 
One of my network drives in the analysis environment is missing 


If you cannot see the Library, Project, and Output network drives in File Explorer, go to the desktop and double-click the 


Refresh Network Drives icon. 


| got an error while working with data in SAS/Stata/R/Python 


Stata error example 


This means you have exceeded the memory for your virtual machine. 


1. Use an alternative method/program to manipulate or process the dataset. Some processes/programs/methods for working 


with large datasets are more memory-intensive than others. Try some alternative method to see if it is less system intensive. 


e Most statistical software tools are able to filter data as it is imported. If your analysis only needs variables a, b andc froma 
dataset containing 30 variables, then selecting, filtering or importing only these variables uses less memory. 


e If you cannot do this in your software, consider creating a subsetted data file using another tool, such as Python, as the 
first step of preparing your data for analysis. 


e If you are unsure of alternative methods, we recommend discussing with other researchers in your project team who are 
more familiar with your chosen statistical software. The ABS does not provide advice or training on using the analytical 
tools provided to you in the DataLab. 


2. Email data.services@abs.gov.au (mailto:data.services@abs.gov.au?Subject=Request for larger virtual machine in DataLab) 


to request a larger machine. Larger machines incur higher running costs. With user charging, you may need to consult with 
your organisation to confirm incurring additional expenses for your project before applying for a larger machine. 


SAS configuration file can now be edited by users with SAS installed 


Users with SAS installed now have the ability to edit the SAS configuration file located at “C:\Program 
Files\SASHome\SASFoundation\9.4\nls\en\sasv9.cfg”. This file governs various software settings and parameters, enhancing 
customisation options. Noting any changes will need to be repeated following machine rebuilds, as the C drive is destroyed on 
rebuild. To modify the SAS config file, follow these steps: 

1. Access the file at the provided directory, using SAS or a text editor. 

2. Proceed to make the necessary changes, in order to tailor the configuration. 

3. Save the file (and a backup version on your P drive, to reinstate following machine rebuilds), then test the software for 


desired outcomes. Exercise caution, as improper edits may lead to unexpected behaviour. 
lam running out of space in my Project drive 
Clean up the drive contents, review and delete redundant files to free up space. 


Email data.services@abs.gov.au (mailto:data.services@abs.gov.au?Subject=Request for storage increase in DataLab) to 


request a storage increase. There may be a cost associated with this. 


Code and software 
I'm unable to type into the Anaconda shell using AVD 
To resolve this issue, you can either: 


e Use an alternative, such as Powershell 7. 


¢ Choose a keyboard layout that matches what you currently use. In the upper right corner of the web client, you can find 
the setting cog. Here you will be able to ‘Enable alternative keyboard layout’ and then select your keyboard layout. The 
most common may be the United States-Internation (QWERTY) keyboard. 


In session 


Select the devices and features that your resource 
can use. 


Microphone 


Keyboard shortcuts (Preview) 


Enable alternative keyboard layout 

Use an Input Method Editor to enter complex 
characters, You must have an Input Method Editor 
enabled in your remote session. Standard 
keyboard input may not work as expected. 


Select remote keyboard layout 


United States-International (QWERTY) ~ 


Enable High DPI 
Enable higher screen resolution 


Show these options every time | connect 


Cancel 


| have some code for one project that | want to use in another project - how do | arrange this 


You can request input clearance (/statistics/microdata-tablebuilder/datalab/input-and-output-clearance#request-input- 


clearance) for data, code or files to be loaded to your project, from either another project, or other sources that you hold. 


Can | use a mix of SAS, STATA, R and Python for different people in my project team 


Yes, each virtual machine has R, STATA and Python as default software. SAS is not automatically provided on all machines 


but can be requested as it requires a licence to be assigned to your virtual machine. Email data.services@abs.gov.au 


(mailto:data.services@abs.gov.au?Subject=Request for SAS or STATA in DataLab) with your request. 


Is cluster processing possible in the DataLab 


Cluster processing is not currently available. We are developing a Databricks service to provide scalable clustered analytics 


environment for users. 


Is there a delay between assigning data to a project and users seeing it 


Yes, it takes about 5 minutes to process the connection. You also need to log out of your virtual machine to allow the system 


to refresh your session with the new data. 


What can | do if my code will run longer than 10pm tonight 


You can extend your session to bypass the nightly shutdown (/statistics/microdata-tablebuilder/datalab/portal-features#vm- 


management-options) , by one, two or three nights. 


How do | see what R packages | have available and how do | manage these 


Use the R Studio Package Manager shortcut on the DataLab virtual machine desktop to check the range of R packages 


available to you. See Managing your R packages (/statistics/microdata-tablebuilder/datalab/using-your- 


workspace#managing-your-r-packages) . 


SAS warning messages 


If the project you opened was saved with SAS Datalab — [machine name] you are connecting to the local SAS server without a 
profile. When you try to run the project without selecting a profile the system may present an error message saying "The 


server "SASMain" is not defined in the current repository". Click though the messages and continue. 


| can't find the R packages | need in the analysis environment 


1. See Managing your R packages (/statistics/microdata-tablebuilder/datalab/using-your-workspace#managing-your-r- 
packages) to use the RStudio Package Manager on the desktop. 


2. If the packages you need is not listed, email your request to data.services@abs.gov.au (mailto:data.services@abs.gov.au? 
Subject=Request for packages in DataLab&Body=We only accept packages from:%0D%0APython%0D%O0A - https:// 
anaconda.org/ (preferred option)%0D%OA - https://pypi.org/%0D%0AStata%0D%OA - https://ideas.repec.org/ 
%0D%0A%0D%0APython packages:%0D%0A - must be compatible with the current version within DataLab (Python 
3.7.4) %0D%0A - Anaconda.org packages must be owned by Anaconda%0D%OA - PyPi.org packages must be wheel 
format (.whl)%0D%0A%0D%O0AStata packages must include the .toc file%OD%0A%0D%O0AR packages%0D%OA - 
https://cran.r-project.org, see Packages/Table of available package, sorted by name%0D%OAOther packages not on 
anaconda, pypi, ideas or cran can be listed below with a business case and ABS will review these. 
%OD%OA%OD%OA%OD%OADear ABS%OD%OAI would like to request the following packages to be added to the DataLab. 


| have confirmed the above requirements have been met:%OD%0A%0D%OA<list package name and include the source 
link>) 


Double clicking to open a PDF is not working 


Due to a default setting in Microsoft, the system automatically uses Microsoft Edge to open any PDF file. You can open the 
PDF file by right-clicking on the file, selecting Open with > Adobe Reader. This launches the file using Adobe Acrobat Reader. 
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How can | enable larger data storage for Postgresql data directory? 


Following recent enhancements, PostgreSQL's data directory relocation is now automated to X:\psql\data when a local disk is 
attached, facilitating expanded storage capacity for data. This feature streamlines the process of accommodating larger 


datasets. To enable local disc please email data.services@abs.gov.au (mailto:data.services@abs.gov.au) 


Contact us 


Key contacts and template emails for ABS DataLab 


Released 20/07/2022 
Enrol in DataLab safe researcher training 


To register interest in DataLab safe researcher training, please use the link on the Safe researcher training page (/statistics/ 


microdata-tablebuilder/datalab/safe-researcher-training) . 


New DataLab project query 


& New DataLab project query (mailto:data.services@abs.gov.au?Subject=New DataLab project query&Body=Dear DataLab 
team%0D%0A%0D%O0AI would like to enquire about setting up a new DataLab project.%OD%0A%0D%O0AProject 
organisation(s):%0D%OAProject title: %0D%OADraft project proposal (if completed):%0D%0A%0D%0A) . 


Template email to submit a query about a new DataLab project 


To: data.services@abs.gov.au 
Subject: New DataLab project query 


Dear DataLab team 
| would like to enquire about setting up a new DataLab project. 


Project Organisation/s: 
Project Title: 
Draft Project Proposal (if completed): 


Existing DataLab project query 


Existing DataLab project query (mailto:data.services@abs.gov.au?Subject=Existing DataLab project query&Body=Dear 
DataLab team%0D%0A%0D%OAI have a query regarding an active DataLab project.%0D%0A%0D%O0AProject name and 
number:%0D%OAProject organisation(s):%ODProject query:%0D%0A%0D%0A) . 


Template email for submitting a query about an existing project 


To: data.services@abs.gov.au 
Subject: Existing DataLab project query 


Dear DataLab team 
| have a query regarding an active DataLab project. 


Project Name and Number: 
Project Organisation/s: 
Project query: 


System Support 


&I System support query (mailto:data.services@abs.gov.au? 

subject=Request% 20System% 20Support&Body=Dear% 20DataLab% 20team%0D%0A%0D%0A1. 

% 201% 20would% 20like % 20to % 20request%20a%20MFA%20reset, 

%20if %20yes% 20please% 20indicate% 20which%20system% 20DataLab/myDATA?%0D%0A%0D%0A2. 

% 201% 20would% 20like% 20to % 20request%20a% 20password% 20reset, 

%20if % 20yes% 20please% 20indicate% 2Z0which%20system% 20DataLab/myDATA?%0D%0A%0D%0A3. 

% 201% 20would% 20like% 20to % 20request% 20assistance% 20with% 20DataLab/myDATA?%0D%0A%0D%OANote: 
%20D0%20not% 20take % 20any % 20screen% 20shots %200r% 20copies % 200f %20the % 20data% 20in% 20the% 20DataLab. 
%OD%OA%OD%0A% OD %0AON% 20which% 20system% 20are% 20you% 20encountering % 20issues % 20DataLab/myDATA? 
%OD*%*OA%ZOD%OA* %20Project%20name%20and%20number% 20(if % 20applicable): 

%OD%ZOA%OD%OA* % 20Virtual % 2ZOmachine% 20(if% 20applicable): ~OD%0A%0D%0A2 %20Exact% 20time/ 

date% 20when% 20the% 20issue% 20was % 20experienced %20(an% 20your% 20time% 20zone): 

%0D%0A%0D% 0A %20Describe%20the% 20system % 20issue% 20inN% 20as%20much% 20detail%20as%20possible: 
%O0D%0A%0D%O0A*® %20Describe%20the% 20steps %20taken%20to % 20reproduce% 20your% 20issue. 
%OD*ZOA%OD%OA* % 2Z0Have % 20you% 20tried % 20troubleshooting% 20using %20the% 20website % 20user% 20guide, 

% 20if % 20applicable? % 20What% 20troubleshooting% 20steps % 20have% 20you% 20take? 

%O0D%OA%OD%0A* %20Are% 2Z0you% 20connected% 20to% 20a% 20network% 20(wifi/wired/ 

VPN) %20at% 20work%200r% 20home? 

%OD%OA%OD%O0A2 %20Are% 20you% 20using% 20Azure% 20Virtual% 20Desktop%20(AVD) 

%200r% 20Citrix%20to% 20access%20your%20DataLab% 20virtual% 20machine, %2O0if applicable? 

%0D%0A%0D% O0A*® % 20What% 20browser% 20and% 20o0perating % 20system% 20are% 20you% 20using% 20and% 20have%2 
Oall% 200utstanding% 20updates % 20been% 20installed? 

%OD*ROA*ZOD%OA* %20Are% 20there% 20any %20error% 20messages %200r% 20logs % 20associated % 20with% 20your, 
%20issue?%20If %20so, 

%20please% 20copy % 20the% 20text% 20o0r % 20any %20images % 20you% 20have% 200f% 20the% 20error% 200r%20logs%2 


Ointo% 2Z0your% 20output% 20drive, %20specifying%20the%2O0location.) (this includes requesting an MFA or password 


reset). 
Template email to request system support 


To: data.services@abs.gov.au 
Subject: Request System Support 


e | would like to request a MFA reset, if yes please indicate which system DataLab/myDATA? 
e | would like a password reset, if yes please indicate which system DataLab/myDATA? 


e | would like to request assistance with DataLab/myDATA system issue. 


Note: Do not take any screen shots or copies of the data in the DataLab. 
On which system are you encountering issues DataLab/myDATA? 


e Project name and number (if applicable): 

e Virtual machine (if applicable): 

e Exact time/date when the issue was experienced (and your time zone): 

e Describe the system issue in as much detail as possible: 

e Describe the steps taken to reproduce your issue: 

e Have you tried troubleshooting using the website user guide, if applicable? What troubleshooting steps have you taken? 
e Are you connected to a network (wifi/wired/VPN) at work or home? 


e Are you using Azure Virtual Desktop (AVD) or Citrix to access your DataLab virtual machine, if applicable? 


What browser and operating system are you using and have all outstanding updates been installed? 


Are there any error messages or logs associated with your issue? If so, please copy the text or any images you have of the 
error or logs into your output drive, specifying the location. 


Request Input or Output Clearance 


To request input or output clearance, please use the relevant links on the Input and output clearance page (/statistics/ 


microdata-tablebuilder/datalab/input-and-output-clearance) . 


Request new software or software packages 


&J Request new software or software packages (mailto:data.services@abs.gov.au?Subject=Request for software or software 


packages in DataLab&Body=Dear DataLab team%0D%0A%0D%OAI would like to request the following software or software 


packages be added to the DataLab.%O0D%0A%O0D%OAList software package name and include the source link: 
%0D%0A%0D%OANote: We only accept software packages from the following sources.%0D%O0APython%0D%O0A- hitps:// 
anaconda.org/ (preferred option) %0D%0A- https://pypi.org/%0D%O0APackages must be compatible with the current version 


within DataLab (Python 3.9.7)%0D%0AAnaconda.org packages must be owned by Anaconda%0D%0APyPi.org packages 
must be wheel format (.whl) %O0D%0A%0D%0AStata%0D%0A- https://ideas.repec.org/%0D%O0AStata packages must 
include the .toc filex~OD%0A%OD% OAR packages%0D%0A- hitps://cran.r-project.org%0D%O0Asee Packages/Table of 


available packages, sorted by name%0D%0A%0D%OAFor DataBricks or other software not currently available in the DataLab 


or software packages not available from anaconda, pypi, IDEAS or CRAN, these can be listed below with a business case and 


ABS will review these.%O0OD%0A%0D%OAList of other software or software packages (include the source link): 
%0D%0A%0D%OABusiness case%0D%0ADoes the file contain data or executables:%0D%OABrief business justification 


including benefit to broader DataLab user group:%0D%O0AWho is the owner of the data/code and are they a recognised and 


trusted source:%O0D%O0AAny terms of use or licensing that apply to the data/code that may restrict its use in the ABS DataLab 


and require additional permissions or conditions:%0D%O0A) (this includes Python, R and stata packages or other software not 


currently supported in the DataLab). 
Template email to request new software or software packages 


To: data.services@abs.gov.au 
Subject: Request for packages in DataLab 


Dear DataLab team 

| would like to request the following software or software packages be added to the DataLab. 
List software package name and include the source link: 

Note: We only accept software packages from the following sources. 

Python 


e https://anaconda.org/ (preferred option) 


e https://pypi.org/ 


Packages must be compatible with the current version within DataLab (Python 3.9.7) 
Anaconda.org packages must be owned by Anaconda 


PyPi.org packages must be wheel format (.whl) 
Stata 
e https://ideas.repec.org/ 
Stata packages must include the .toc file 
R packages 
e https://cran.r-project.org 


For DataBricks or other software not currently available in the DataLab or software packages not available from anaconda, 


pypi, IDEAS or CRAN, these can be listed below with a business case and ABS will review these. 
List of other software or software packages (include the source link): 


Business case 

Does the file contain data or executables: 

Brief business justification including benefit to broader DataLab user group: 

Who is the owner of the data/code and are they a recognised and trusted source: 

Any terms of use or licensing that apply to the data/code that may restrict its use in the ABS DataLab and require additional 


permissions or conditions: 
Notification of upcoming publication 


&I Notification of upcoming publication (mailto:data.services@abs.gov.au?Subject= Notification of upcoming 


publication&Body=In accordance with the Conditions of Use | hereby notify the ABS of the intention to publish the following 


(attached) publication.%O0D%0A%0D%O0AThis process is not seeking approval from the custodians and is simply in place to 


give the custodians an opportunity to get across project outputs, provide comments and brief ministers, as required. 


%OD%ZOA%OD%OAI can confirm my published results have been appropriately referenced to the data source/s, and an 


explanation of any processes or transformations which have been applied to that data, and any relevant data disclaimers have 


been included.) 
Template email to notify ABS of an upcoming publication 
Template email to notify ABS of an upcoming publication 


To: data.services@abs.gov.au 


Subject: Notification of upcoming publication 
Dear DataLab team 


In accordance with the Conditions of Use | hereby notify the ABS of the intention to publish the following (attached) 


publication. 


This process is not seeking approval from the custodians and is simply in place to give the custodians an opportunity to get 


across project outputs, provide comments and brief ministers, as required. 


| can confirm my published results have been appropriately referenced to the data source/s, and an explanation of any 


processes or transformations which have been applied to that data, and any relevant data disclaimers have been included. 


All other queries 


For all other queries, please contact us via email at data.services@abs.gov.au (mailto:data.services@abs.gov.au) . This email 


account is monitored and we will respond to your query during standard business hours, Monday to Friday. 


